Kiran Kumar Kolla,澳大利亚新南威尔士州悉尼的开发商
Kiran is available for hire
Hire Kiran

Kiran Kumar Kolla

Verified Expert  in Engineering

Database Engineer and Developer

Location
Sydney, New South Wales, Australia
Toptal Member Since
July 28, 2021

Kiran是一名数据库工程师,拥有十多年实现数据湖的专业知识, data integrations, and data warehousing solutions. 除了与Cognizant的数据工程工作和与NBN公司的无线工作, Kiran拥有大都会人寿金融服务的企业经验, ING Group, to Bank of America. 当挑战抛向他时,他是高度激励的,因为他们激发了他最好的一面! Kiran喜欢编程,喜欢用逻辑思维有效地解决复杂的问题.

Portfolio

Data-Driven AI
Azure, Azure数据工厂,Azure Synapse, Databricks, Microsoft Power Apps...
NBN Co
Redshift、AWS Lambda、Alteryx、Tableau Desktop Pro、Amazon S3 (AWS S3)...
MetLife
采购产品Alteryx, Tableau, SQL,仪表板,仪表板设计,监管报告...

Experience

Availability

Part-time

Preferred Environment

Azure SQL, Databricks, Azure Data Factory, Python 3, Data Warehousing, Apache Airflow, Tableau Desktop Pro, Amazon Web Services (AWS), Spark, Microsoft Power Apps

The most amazing...

...我实现的是一个操作数据湖,用于从与不同传输模式相关的开放数据中心api中摄取实时数据.

Work Experience

Senior Data Engineer

2020 - PRESENT
Data-Driven AI
  • 开发了Azure持久实体函数,以便在响应头发生变化时从Open data Hub api中摄取数据. 这一举措每天节省了8GB的存储空间,显著降低了成本.
  • 在Microsoft Power Apps中构建了一个应用程序,从Azure订阅中获取资源使用成本和成本优化建议. The app helped users monitor resources and reduce costs.
  • 为企业用户创建了自助服务API和Microsoft power应用程序,无需人工干预即可安全地从数据湖中按需下载历史GTFS数据. The action saved 40 hours of manual effort every month.
  • 使用Azure Databricks (Pyspark)构建数据管道,将摄取的数据处理到Delta湖和Synapse数据仓库中.
  • 使用Databricks创建流数据管道,从Event Hub和Cosmos DB中摄取数据.
Technologies: Azure, Azure数据工厂,Azure Synapse, Databricks, Microsoft Power Apps, Microsoft Power Automate, Azure Functions, Azure Logic Apps, Azure Automation, Azure DevOps, Data Lakes, Data Engineering, Python, C#, Microsoft Power BI, PySpark, Azure IaaS, Data Pipelines, T-SQL (Transact-SQL), Pandas, Data Cleansing

Data Engineer

2019 - 2020
NBN Co
  • 使用AWS EMR和Lambda上的Spark开发自动化ETL数据管道来处理数据, such as orders and services, from Comptel 7 and Maximo into an AWS S3 data lake.
  • 使用Python创建基于事件的Lambda函数来触发Glue爬虫和元数据标记.
  • 开发数据管道,将订单数据从UDS KPI模型转换为业务友好的视图,便于数据分析和报表.
Technologies: Redshift、AWS Lambda、Alteryx、Tableau Desktop Pro、Amazon S3 (AWS S3), Apache Airflow, ETL, Amazon Elastic MapReduce (EMR), Spark, Data Lakes, Python, Tableau, Data Modeling, SQL, SQL Server Integration Services (SSIS), PySpark, T-SQL (Transact-SQL), Pandas, Data Visualization, Amazon Web Services (AWS), Data Cleansing

Data Analyst

2018 - 2019
MetLife
  • 创建Alteryx工作流,从多个源系统中提取数据,并准备数据提交监管.
  • 为监管报告(包括APRA)准备数据, ASIC, and LCCC) and generated reconciliation dashboards.
  • 根据业务需求设计和开发Tableau功能仪表板.
Technologies: 采购产品Alteryx, Tableau, SQL,仪表板,仪表板设计,监管报告, T-SQL (Transact-SQL), Data Visualization, Data Cleansing

Data Engineer

2017 - 2018
ING Group
  • 执行通用报告标准(CRS)工作流程以生成客户和帐户摘要.
  • Developed an ETL framework using Informatica workflow, Windows PowerShell, 和SQL来自动化数据仓库的批调度过程.
  • 为个人贷款和信用卡产品创建数据模型,以加载事务数据.
Technologies: Informatica ETL, Data Warehouse Design, Python, Windows PowerShell, Data Warehousing, SQL, ETL, Dimensional Modeling, T-SQL (Transact-SQL)

Senior Analyst

2013 - 2017
Bank of America
  • 实现了Informatica ETL COE操作报告解决方案,以帮助管理人员生成关于平台使用情况的报告, the number of sessions executed, and the volume of data processed.
  • 为应用程序支持和平台维护团队自动化每月指标报告的过程, using Excel VBA and Microsoft SQL Server, which saved a lot of manual effort.
  • 完成了所有Informatica ETL COE平台升级到v10的过程.2 .使用Jenkins和shell脚本实现流程自动化.
技术:Informatica ETL, Shell脚本,Tableau, ETL,数据可视化

ETL Developer

2008 - 2013
Cognizant
  • 开发自动数据协调工作流,将数据与从源系统接收的控制文件进行比较.
  • 创建了Autosys工作流,以设置作业依赖关系和时间表.
  • 使用Oracle PL/SQL创建存储过程来执行数据验证.
Technologies: Informatica ETL, Oracle, SQL Server Integration Services (SSIS), Autosys, Data Cleansing

Operational Data Lake for Transport

一个用于运输的操作数据湖,可以获取和处理来自物联网设备的实时行程更新和车辆位置数据. I developed the data lake, 作为多模式性能报告的一部分,哪些构成了许多业务用例的数据基础.

Web Scraping

http://www.teamrankings.com
一个Python可执行文件,用于从TeamRanking网站提取关于日常日程安排的数据, for those teams, get the latest rankings for different categories. I created this using Pandas, openpyxl, 和Beautiful Soup库,从NCAA网站提取数据,并生成一个Excel文件,其中包含所有球队及其在不同领域的优势, which are color-coded.

Monitoring Application for Azure Cloud

一个Microsoft Power应用程序,用于监控多个订阅的资源及其消耗成本. 我开发了这个应用程序,并创建了从Power应用程序使用的Azure订阅中获取资源和成本信息的函数, 这有助于云管理员监控成本和创建的资源.

Languages

Python 3, SQL, Python, T-SQL (Transact-SQL), C#

Frameworks

Windows PowerShell, Spark, Azure Bot Framework

Libraries/APIs

熊猫,PySpark, Azure认知服务,靓汤

Tools

Azure Logic Apps, Informatica ETL, Tableau Desktop Pro, Tableau, Microsoft Power Apps, Autosys, Azure Automation, Apache Airflow, Azure Machine Learning, Amazon Elastic MapReduce (EMR), Microsoft Power BI

Paradigms

ETL、多维建模、Azure DevOps、DevOps、商业智能(BI)

Platforms

Databricks, Azure, Oracle, Azure Synapse, Microsoft Power Automate, Azure Functions, Alteryx, Azure IaaS, Azure PaaS, AWS Lambda, Amazon Web Services (AWS)

Storage

Azure SQL, Data Pipelines, Data Lakes, SQL Server Integration Services (SSIS), Redshift, Amazon S3 (AWS S3)

Other

Azure Data Factory, Data Warehousing, Azure Data Lake Analytics, Software Development, Data Warehouse Design, Shell Scripting, Data Engineering, Data Architecture, Data Cleansing, Web Scraping, Dashboards, Dashboard Design, Data Modeling, Microsoft Data Transformation Services (now SSIS), Data Analysis, Data Visualization, Cloud Security, Cloud Services, Data Analytics, Regulatory Reporting, Internet of Things (IoT), Excel 365

2002 - 2006

Bachelor's Degree in Computer Science

Jawaharlal Technological Universilty - Hyderabad, India

JULY 2021 - PRESENT

Azure AI Fundamentals

Microsoft

DECEMBER 2020 - DECEMBER 2022

Azure Data Engineer Associate

Microsoft

SEPTEMBER 2020 - PRESENT

Azure Fundamentals

Microsoft

AUGUST 2018 - JANUARY 2021

Tableau Desktop Certified Associate

Tableau

Collaboration That Works

How to Work with Toptal

在数小时内,而不是数周或数月,我们的网络将为您直接匹配全球行业专家.

1

Share your needs

在与Toptal领域专家的电话中讨论您的需求并细化您的范围.
2

Choose your talent

在24小时内获得专业匹配人才的简短列表,以进行审查,面试和选择.
3

Start your risk-free talent trial

与你选择的人才一起工作,试用最多两周. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring