Dheeraz Chavali

Software Engineer

accenture•  February 2022 - Present

1. Synthesized large datasets into actionable insights, elevating decision-making. 2. Expanded and modified systems to strengthen workflow. Managed lifecycle elements of ETL development, from robust testing to final deployment. 3. Created a process involving AWS Lambda to automatically feed the data in Data-Warehouse by avoiding manual intervention. 4. Implemented Apache Kafka by hosting it on AWS platform to capture real time data as a replacement to on-premises data marts. 5. Debugged and resolved authentication and configuration related issues with YARN and HDFS. 6. Performed Extract, Transform, Load (ETL) processes to support data warehouse system.

Data Engineer

Indium Software Inc.•  May 2021 - December 2021

• Extracted and analysed business large customer Data to generate analytical insights using Python, SQL, Apache Spark and Hive which aided in making business decisions. • Developed and Automated ETL models using Python and Hive SQL to enhance business processes and automate data extraction with an improved efficiency and reducing manual work hours by 40%. • Collaborated in a proof-of-concept for data marts in Hadoop using data lake pattern design. • Expertise in Data ingestion tools like Apache Kafka, Confluent Kafka tools like KSQL, K-tables and Schema registry. • Tuned Spark jobs to achieve better performance, clean Spark code and efficient memory management. • Developed a Data Ingestion service which uses Real time processing with larger workloads and volumes from Amazon S3 and loads the data into the data warehouse which is used for Business Analytics purposes. • Developed patterns in Python and Apache Spark for migrating Data and processes away from legacy platforms.

Programmer Analyst Trainee

Cognizant Technology Solutions•  February 2021 - July 2021

• Developed simple and complex Stored Procedures and involved as team member in designing data model • Developed a Retail Banking System model using Java programming, Spring (Boot, MVC), Maven and MySQL and my role was to deal with Databases.

SASTRA Deemed University

Electronics and Communication Engineering, B.Tech•  July 2017 - August 2021

CGPA - 7.675