Krishna Agrawal

Senior Data Engineer

Pythian Technology•  July 2022 - Present•  Remote, India

Developed and optimized robust data pipelines, including Kafka Connect and event ingestion systems capable of processing terabytes of data per second into HDFS. Successfully designed and implemented data models for multi-source reporting in BigQuery, significantly enhancing reporting capabilities. Additionally, Optimized and developed EDP pipelines in GCP and Azure, leveraging advanced debugging techniques to ensure highly efficient, consistent, and scalable performance.

Data Engineer

Cuelogic Technology | LTI Company•  April 2021 - July 2022•  Pune, India

Contributed to the development of Discover Your Data (DyD), an advanced tool utilizing augmented analytics and machine learning to enhance healthcare provider monitoring. Detect and mitigate fraud, waste, and abuse using AWS.

Associate(Developer)

Cognizant Technology Solutions•  September 2018 - April 2021•  Pune, India

The healthcare client resolved query performance issues by migrating data from Oracle RDBMS to HDFS using Apache Sqoop. The data was transformed with Hadoop, Hive, and Spark, then loaded into Elasticsearch, enabling fast, real-time queries and improving healthcare-specific calculations.