d
data_er_harsh

Harsh A

@data_er_harsh

Data Engineer

India
Hindi, English
About me
I am a Data Engineer with 3+ years of experience designing and deploying data integration solutions using Python, PySpark, and Azure Databricks. I have delivered measurable impact for Fortune 500 clients, including a 75% reduction in pipeline latency and improving data quality from 70% to 95%.... Read more

Skills

d
data_er_harsh
Harsh A
Offline • 
Average response time: 6 hours

See my services

Data Engineering Consulting
I will help you clean and transform your datasets so they are ready for analysis

Work experience

Cognizant

Data Engineer

Cognizant • Full-time

Sep 2023 - Present • 3 yrs 2 mos

• Built and deployed PySpark ETL pipelines on Azure Databricks, transforming multi-source datasets via filtering and joining operations, reducing manual intervention by 80% with reliable delivery to designated target systems. • Designed and implemented 100+ Ataccama DQ rules to identify and flag invalid records across datasets with 1M+ records, improving data quality from 70% to 95% and ensuring enterprise-grade reliability for life sciences data. • Accelerated business decision-making by implementing Medallion Architecture (Bronze→ Silver→ Gold) on Azure Databricks, delivering BI-ready governed data across 100+ tables for reliable stakeholder consumption. • Eliminated multi-week reporting delays by designing Power BI dashboards with daily refreshed insights, enabling self-serve, real-time visibility for stakeholders across integrated target platforms.