Senior Data Engineer Spark AWS SQL Python Databricks
Pakistan
English
About me
Accomplished IT professional with over 14 years of experience specializing in Big Data engineering, ETL/ELT workflows, and advanced analytics. extensive hands‑on experience with AWS services such as Glue, Lambda, Redshift, RDS, S3, CloudWatch, and IoT Analytics. I’ve designed and developed end‑to‑end ETL/ELT pipelines, implemented data ingestion workflows for Snowflake and Redshift using AWS Glue/Lambda. Leveraging the AWS Glue Data Catalog, I’ve built real‑time streaming pipelines with PySpark and Kafka, and automated ingestion, Databricks Delta pipelines for ACID transactions... Read more