I will automate etl pipeline using data factory and databricks

Hello,

Hope you are good.

I have more than 4yr of experience working as Data Engineer in multiple domain, having hands on experience of developing highly complex ETL pipelines.

My services include:

• Building the end-to-end solution in Azure Data Factory with Copy data/Mapping Data Flow.
• complex queries optimization
• Data load , Transformation, and Orchestration (ETL process)
• Migration of data from On-Prem systems or application APIs to ADLS, Blob storage
• Developing complex transformations using DataBricks in Python/PySpark/SparkSQL
• Move the processed data to Delta Lake, Data Ware house , Azure SQL Database (SSMS), MSSQL
• Use of Azure keyVault
• Create SQL Stored Procedures/ Functions /Views/ Queries
• Multiple source and destination support like FTP, DB, Datawarehouse, DataLake
• Notify based on failure or success pipeline events using azure logic apps
• Develop and maintain Delta live table architecture in databricks
• Create dashboard in Databricks
• Enforcing security and Best practices in code and environments
• Pipeline scheduling

Why me?

1. 100% client satisfaction
2. Neat and Clean Code
3. Good Communicator
4. Delivery on time.

**PLEASE GET IN TOUCH BEFORE ORDERING A GIG!!!**