I will azure data factory etl pipelines and migrate data to adls gen2

Looking to migrate your legacy on-premise data warehouse to Azure without downtime? You are in the right place!

I am a Cloud & Data Engineer specializing in designing robust, enterprise-grade data ingestion pipelines. I will help you move large-scale transactional databases or set up automated incremental loads efficiently.

What I Offer:

• On-Premise to Cloud Migration: Seamless data movement from MS SQL Server to Azure Data Lake Storage (ADLS Gen2).
• Metadata-Driven Pipelines: Advanced ADF architecture using Parent-Child designs and ForEach loops for parallel processing.
• Incremental Load (Watermark Logic): Custom control table architecture with dynamic T-SQL to ensure efficient daily loads without redundancy.
• Dynamic Partitioning: Structuring clean directory hierarchies using ADF expressions and saving data in high-performance Snappy-compressed Parquet format.
• Self-Hosted IR Setup: End-to-end SHIR configuration and complex JRE/JVM troubleshooting.

Tech Stack: Azure Data Factory (ADF), ADLS Gen2, MS SQL Server, T-SQL, Parquet.

Please contact me before placing an order to discuss your project requirements!