Badges
Certifications
ayush_kushwaha77 has not earned any certificates yet.
Work Experience
Data Engineering Analyst
accenture• June 2021 - Present
● Involved in Creation of delta tables, partitioning tables, Join conditions, correlated subqueries, nested queries, views and sequences for the business application development. ● Extensively involved in writing SQL queries (Sub queries and Join conditions). ● Collaborated with various teams to understand the requirement & design to complete the development of PySpark code on Azure Databricks. ● Developed PySpark jobs using Spark SQL & Data Frames for aggregation and generated the final report table to load it into Azure Synapse Analytics. ● Performance Optimization and Job tuning are done on jobs for better performance. Performed thorough data analytics using PySpark on Databricks platform. ● Performing unit testing on the jobs which includes the job execution, null value, string length and duplicate checks. ● Involved in the migration activities from Hortonworks to Azure. Used ADF for data copy activities. ● Create, maintain and monitor the jobs on the CA Scheduler i.e.,ESP dSeries Workload Automation. ● Closely worked with Data Scientist to understand their requirement and deliver the appropriate by developing SQL and pyspark scripts. ● Maintaining the code version control using Github.
Junior Engineer - IMTS
Mindtree• September 2019 - June 2021
● Have 1.8 years of experience as a technical support engineer for Azure Databricks. ● Have hands-on experience in Azure cloud technologies like Azure Databricks, ADF, Azure Synapse, Azure SQL Databases and ADLS. ● Knowledge in SQL, Pyspark and delta tables ● Troubleshooting and finding the root cause of the failed pipeline/jobs. ● Multitasked to handle diverse customer needs in high-volume, prioritizing tasks to keep up with challenging deadlines.
Education
SRM University, Chennai (SRM Institute Of Science & Technology)
Electrical and Electronics Engineering, B.Tech• June 2015 - May 2019