I will build etl pipelines, pyspark workflows, and looker dashboard using airflow, sql
Data Analyst Scientist
Level 2
Has met high performance criteria and has a proven track record for meeting client expectations.
Highly Responsive
Known for exceptionally quick replies
About this Gig
Need reliable data pipelines that deliver clean, analysis-ready data on schedule? I build enterprise-grade ETL/ELT pipelines using the modern data stack.
WHAT I DELIVER:
ETL & ELT pipeline development with Apache Airflow DAGs & operators
PySpark & Spark big data processing and transformation workflows
Data warehousing with Snowflake, BigQuery, Redshift & Databricks
Looker Studio & Looker dashboards for data visualization layer
dbt transformation models, tests & full documentation
Cloud pipelines on AWS Glue, Azure Data Factory & GCP Composer
️ TECH STACK:
PySpark | Apache Airflow | SQL | dbt | Snowflake | BigQuery | AWS Glue | Azure Data Factory | Kafka | Databricks
⭐ WHY CHOOSE ME:
5.0 rated with 100+ projects completed. 5+ years in data engineering, delivering production pipelines for analytics teams at scale. Complete documentation and knowledge transfer included.
Share your data sources and I'll provide a free architecture plan!
FAQ
What cloud platforms do you build ETL pipelines on?
I build on AWS (Glue, Lambda, S3, Redshift, EMR), Azure (Data Factory, Databricks, Synapse Analytics), and GCP (Cloud Composer, BigQuery, Dataflow). I'll recommend the best platform based on your existing infrastructure, team skills, and budget — and I provide this recommendation for free before you
What is Apache Airflow and do I need it?
Apache Airflow is a workflow orchestration tool that schedules, monitors, and retries your data pipelines automatically. If you need data processed on a regular schedule (hourly, daily, event-driven), Airflow is essential. I design production-ready Airflow DAGs with proper retry logic, alerting, and
What is the difference between ETL and ELT?
ETL (Extract-Transform-Load) processes and cleans data before loading it into your data warehouse — better for legacy systems and strict data governance. ELT (Extract-Load-Transform) loads raw data first and transforms inside the warehouse using tools like dbt — better for modern cloud stacks like S
Can you migrate our on-premise database to the cloud?
Yes. I specialize in migrating from SQL Server, Oracle, MySQL, and flat files to cloud warehouses like Snowflake, BigQuery, and Redshift. This includes schema design, data type mapping, validation testing, incremental load setup, and historical data backfill — fully documented.
Will I receive documentation for the pipelines you build?
Every delivery includes full technical documentation: pipeline architecture diagram, DAG descriptions, transformation logic explanation, data dictionary, setup guide, and runbook for your team. My goal is that any data engineer on your team can understand and extend the pipelines independently.
1 reviews for this Gig
| (0) | ||
| (1) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
R radnair578

Australia
Sham has done an excellent job for me
$50
Price
4 days
Duration
A 
Seller's Response
Helpful?
1 reviews for this Gig
| (0) | ||
| (1) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
R radnair578

Australia
Sham has done an excellent job for me
$50
Price
4 days
Duration
A 
Seller's Response
Helpful?
