b
balajiyadav855

Balaji

@balajiyadav855

Azure Data Engineer

India
English, Telugu, Hindi
About me
I am an Azure Data Engineer with 3 years of experience in Azure Databricks, PySpark, Apache Spark, SQL, Azure Data Factory, ADLS Gen2, Delta Lake, Unity Catalog, Structured Streaming, and Azure DevOps. I build end-to-end ETL/ELT pipelines, perform data ingestion and transformation, implement incremental loads and Delta MERGE, optimize Spark jobs, and troubleshoot production issues. I have experience with Bronze, Silver, and Gold architectures, data governance, CI/CD, pipeline orchestration, monitoring, and delivering curated data for downstream applications and reporting.... Read more

Skills

b
balajiyadav855
Balaji
Offline • 
Average response time: 1 hour

See my services

Data Engineering Consulting
I will build azure databricks pyspark and adf etl data pipelines
From$20 / projectMore details

Work experience

Cognizant

Azure Data Engineer

Cognizant • Full-time

Oct 2022 - Jun 2026 • 3 yrs 8 mos

I worked as an Azure Data Engineer at Cognizant for around 4 years, developing and maintaining end-to-end ETL pipelines. My work involved Azure Data Factory for orchestration, Azure Databricks with PySpark and SQL for data transformation, and ADLS Gen2 and Delta Lake for storage. I handled data ingestion, incremental loads, data validation, Spark performance optimization, pipeline monitoring, troubleshooting, and production support. I also worked with Medallion Architecture, Unity Catalog, Structured Streaming concepts, and CI/CD using Azure DevOps.