AWS and Azure Data Engineer for PySpark, ETL and Data Pipelines
India
English
About me
Data Engineer with nearly 5 years building production pipelines on AWS and Azure, currently at a SEBI-regulated fintech. AWS Certified Data Engineer - Associate.
I build and fix ETL/ELT pipelines with PySpark, SQL, Python and Airflow on AWS (Glue, Lambda, S3, Redshift, Athena) and Azure (Data Factory, Synapse, Databricks), plus Snowflake.
Recent work: 100GB+ market-data migration, 30% faster Redshift queries, PySpark data validation at 99.9% accuracy, LLM data-prep pipelines.
Clear updates, documented handover. IST, with EU/US overlap.... Read more