
Umer Khan
Data Engineer
Skills

Portfolio
Work experience
Data Engineer
Bytewise Limited • Full-time
Feb 2024 - Present • 2 yrs 6 mos
Designed and developed end-to-end ETL/ELT data pipelines using Python, SQL, Microsoft Fabric, Snowflake, AWS, and Databricks for diverse client requirements. Integrated data from APIs, CSV/JSON files, cloud storage, SaaS platforms, and relational databases, transforming raw data into analytics-ready datasets. Built data pipelines using Microsoft Fabric Lakehouse, Data Warehouse, Notebooks, Medallion Architecture, and star-schema data modeling. Developed Snowflake-centric ELT solutions using stages, file formats, COPY INTO, internal/external tables, VARIANT, and advanced SQL transformations. Implemented data cleansing, normalization, deduplication, validation, joins, aggregations, and business-rule transformations to improve data quality. Built scalable AWS-based pipelines using S3, Lambda, Glue (PySpark), Redshift, Step Functions, and EventBridge. Worked with Databricks and PySpark for distributed processing of large and semi-structured datasets. Automated and monitored data workflows using scheduling and orchestration tools, ensuring reliable data delivery for reporting and analytics. Troubleshot pipeline failures, data-quality issues, schema changes, and performance bottlenecks while delivering solutions aligned with client business requirements.