I will build scalable etl pipelines using microsoft azure, pyspark,databricks and sql

India

I speak English, Hindi
In my current role, I’m working in the pharmaceutical domain on a project titled “AU–EU Pharmaceutical Sales Analytics Pipeline” for a global pharma client based in the United States. The client faced...
About this Gig

Are you struggling to build reliable, automated, and scalable data pipelines in Microsoft Azure?

Youre in the right place.

I am an Azure Data Engineer with hands-on experience building enterprise-grade ETL/ELT pipelines for global pharmaceutical clients. I help businesses modernize their data ecosystem using Azure services such as:

  • Azure Data Factory (ADF) orchestration, scheduling, and automation
  • Azure Databricks (PySpark) big data transformation & processing
  • Azure Data Lake Storage Gen2 structured data lake zones (Bronze/Silver/Gold)
  • Azure Synapse Analytics fast SQL analytics & data warehousing
  • Azure Functions & Logic Apps serverless, event-driven automation
  • Azure Key Vault & Monitor enterprise security, auditing & alerting
  • Azure DevOps CI/CD deployment pipelines

I design pipelines that are secure, cost-effective, maintainable, and performance optimized.


What Makes My Service Different?

End-to-End Pipeline Ownership

From ingestion validation transformation warehousing reporting,

I manage every step of your data lifecycle.

High-Performance ETL/ELT

I build pipelines that can handle millions of rows, with optimized Spark jobs, delta-based processing, and scalable architectures.

Destination Platform:

Amazon Redshift

Azure Synapse Analytics

Tools & Platforms:

AWS Glue DataBrew

Kafka Connect

Talend