Kiran Kumar Kolla
Verified Expert in Engineering
Database Engineer and Developer
Kiran是一名数据库工程师,拥有十多年实现数据湖的专业知识, data integrations, and data warehousing solutions. 除了与Cognizant的数据工程工作和与NBN公司的无线工作, Kiran拥有大都会人寿金融服务的企业经验, ING Group, to Bank of America. 当挑战抛向他时,他是高度激励的,因为他们激发了他最好的一面! Kiran喜欢编程,喜欢用逻辑思维有效地解决复杂的问题.
Portfolio
Experience
Availability
Preferred Environment
Azure SQL, Databricks, Azure Data Factory, Python 3, Data Warehousing, Apache Airflow, Tableau Desktop Pro, Amazon Web Services (AWS), Spark, Microsoft Power Apps
The most amazing...
...我实现的是一个操作数据湖,用于从与不同传输模式相关的开放数据中心api中摄取实时数据.
Work Experience
Senior Data Engineer
Data-Driven AI
- 开发了Azure持久实体函数,以便在响应头发生变化时从Open data Hub api中摄取数据. 这一举措每天节省了8GB的存储空间,显著降低了成本.
- 在Microsoft Power Apps中构建了一个应用程序,从Azure订阅中获取资源使用成本和成本优化建议. The app helped users monitor resources and reduce costs.
- 为企业用户创建了自助服务API和Microsoft power应用程序,无需人工干预即可安全地从数据湖中按需下载历史GTFS数据. The action saved 40 hours of manual effort every month.
- 使用Azure Databricks (Pyspark)构建数据管道,将摄取的数据处理到Delta湖和Synapse数据仓库中.
- 使用Databricks创建流数据管道,从Event Hub和Cosmos DB中摄取数据.
Data Engineer
NBN Co
- 使用AWS EMR和Lambda上的Spark开发自动化ETL数据管道来处理数据, such as orders and services, from Comptel 7 and Maximo into an AWS S3 data lake.
- 使用Python创建基于事件的Lambda函数来触发Glue爬虫和元数据标记.
- 开发数据管道,将订单数据从UDS KPI模型转换为业务友好的视图,便于数据分析和报表.
Data Analyst
MetLife
- 创建Alteryx工作流,从多个源系统中提取数据,并准备数据提交监管.
- 为监管报告(包括APRA)准备数据, ASIC, and LCCC) and generated reconciliation dashboards.
- 根据业务需求设计和开发Tableau功能仪表板.
Data Engineer
ING Group
- 执行通用报告标准(CRS)工作流程以生成客户和帐户摘要.
- Developed an ETL framework using Informatica workflow, Windows PowerShell, 和SQL来自动化数据仓库的批调度过程.
- 为个人贷款和信用卡产品创建数据模型,以加载事务数据.
Senior Analyst
Bank of America
- 实现了Informatica ETL COE操作报告解决方案,以帮助管理人员生成关于平台使用情况的报告, the number of sessions executed, and the volume of data processed.
- 为应用程序支持和平台维护团队自动化每月指标报告的过程, using Excel VBA and Microsoft SQL Server, which saved a lot of manual effort.
- 完成了所有Informatica ETL COE平台升级到v10的过程.2 .使用Jenkins和shell脚本实现流程自动化.
ETL Developer
Cognizant
- 开发自动数据协调工作流,将数据与从源系统接收的控制文件进行比较.
- 创建了Autosys工作流,以设置作业依赖关系和时间表.
- 使用Oracle PL/SQL创建存储过程来执行数据验证.
Experience
Operational Data Lake for Transport
Web Scraping
http://www.teamrankings.comMonitoring Application for Azure Cloud
Skills
Languages
Python 3, SQL, Python, T-SQL (Transact-SQL), C#
Frameworks
Windows PowerShell, Spark, Azure Bot Framework
Libraries/APIs
熊猫,PySpark, Azure认知服务,靓汤
Tools
Azure Logic Apps, Informatica ETL, Tableau Desktop Pro, Tableau, Microsoft Power Apps, Autosys, Azure Automation, Apache Airflow, Azure Machine Learning, Amazon Elastic MapReduce (EMR), Microsoft Power BI
Paradigms
ETL、多维建模、Azure DevOps、DevOps、商业智能(BI)
Platforms
Databricks, Azure, Oracle, Azure Synapse, Microsoft Power Automate, Azure Functions, Alteryx, Azure IaaS, Azure PaaS, AWS Lambda, Amazon Web Services (AWS)
Storage
Azure SQL, Data Pipelines, Data Lakes, SQL Server Integration Services (SSIS), Redshift, Amazon S3 (AWS S3)
Other
Azure Data Factory, Data Warehousing, Azure Data Lake Analytics, Software Development, Data Warehouse Design, Shell Scripting, Data Engineering, Data Architecture, Data Cleansing, Web Scraping, Dashboards, Dashboard Design, Data Modeling, Microsoft Data Transformation Services (now SSIS), Data Analysis, Data Visualization, Cloud Security, Cloud Services, Data Analytics, Regulatory Reporting, Internet of Things (IoT), Excel 365
Education
Bachelor's Degree in Computer Science
Jawaharlal Technological Universilty - Hyderabad, India
Certifications
Azure AI Fundamentals
Microsoft
Azure Data Engineer Associate
Microsoft
Azure Fundamentals
Microsoft
Tableau Desktop Certified Associate
Tableau
How to Work with Toptal
在数小时内,而不是数周或数月,我们的网络将为您直接匹配全球行业专家.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring