m
manish7lucky

Manish D.

@manish7lucky

Data Enginner and Python Developer

India
English, Hindi, Bengali
About me
Data Engineer building automated, production-grade pipelines from ingestion to analytics-ready warehouses. Built: a 1B+ row batch pipeline (Airflow, S3, Snowpipe, dbt) and a real-time streaming pipeline (Kafka, PySpark, Databricks, Delta Lake) with anomaly detection. Stack: Python, SQL, Airflow, dbt, PostgreSQL, Snowflake, AWS, Docker, Kafka. I can build ETL pipelines, automate reporting/spreadsheet syncs, set up Airflow orchestration, design dbt models, or fix a broken pipeline. Currently pursuing BS Data Science at IIT Madras. Clean code, clear scope, no surprises.... Read more

Skills

m
manish7lucky
Manish D.
Offline • 

See my services

Data ETLs
I will build a python etl pipeline for your data
From$10 / projectMore details

Portfolio

Work experience

Personal_portfolio project

Nyc Taxi Data Pipeline

Personal portfolio project • Self-employed

Jul 2026 - Present • 3 mos

end to end production style data pipeline that reduces ingestion speed by 40%