I will implement data pipelines, conduct analysis and quality enhancements

United States

I speak English
With over 5 years of experience, I have honed my skills as an data warehouse architect utilizing MSSQL, SSIS, Databricks, Java and Python. My expertise lies in designing, testing, deploying, and maint...
About this Gig

Reliable | Scalable | Maintainable | Cloud-Ready


I possess experience working with large scale data pipelines under an industry leading data warehousing company. I also hold multiple certifications from AWS, GCP and Databricks. My track record includes successfully delivering large-scale projects, and processing billions of events with impressively low latencies.


Services Include:

  • ETL & ELT pipelines (batch & streaming)
  • Integration with APIs, cloud storage, and databases
  • Cloud-native deployment: AWS Glue, Lambda, Azure ADF, Databricks, GCP Dataflow, Airflow
  • Real-time architecture using Kafka, Pub/Sub, or Event Hubs
  • Data cleaning, quality checks, audit logging
  • Cost Optimization strategies
  • Compliance guarantees with GDPR, HIPAA, CCPA and SOC2


Note: Message me before ordering to make sure I scope your project perfectly!


Destination Platform:

Google BigQuery

•

Databricks Lakehouse

Tools & Platforms:

AWS Glue DataBrew

•

Google Cloud Dataflow