I will build a python etl pipeline for your data

India

I speak Bengali, English, Hindi

Data Enginner and Python Developer

Data Engineer building automated, production-grade pipelines from ingestion to analytics-ready warehouses. Built: a 1B+ row batch pipeline (Airflow, S3, Snowpipe, dbt) and a real-time streaming pip...
About this Gig

Have scripts that work but run manually or without proper scheduling? 

I'll wrap your existing data workflow in production-grade 

orchestration.


What you get:

- Apache Airflow DAGs to schedule and monitor your existing scripts

- Proper error handling and retry logic

- Optional: dbt models to replace ad-hoc SQL transformations with 

 tested, version-controlled ones

- Optional: data quality tests and source freshness checks


This is the same orchestration pattern I used to run a 1B+ row batch 

pipeline reliably scaled down to fit your existing codebase, not 

rebuilt from scratch.


Share your current scripts/repo structure in the requirements so I 

can scope accurately before starting.

Destination Platform:

Snowflake

•

Google BigQuery

•

PostgreSQL

•

MySQL

Tools & Platforms:

AWS Glue DataBrew

•

Kafka Connect

•

Other

My Portfolio