I will build scalable data pipelines and etl with python, sql, airflow and databricks
About this Gig
Need reliable data pipelines that just work? I'm a Data Engineer with an M.Sc. in Data Science and industry experience at Amazon and Tata Consultancy Services, where I built pipelines processing 1TB+ of data for 100+ analysts.
What I can build for you:
- ETL/ELT pipelines in Python and SQL
- Data integration from APIs, databases, CSV/Excel and cloud storage
- Scheduled workflows with Apache Airflow
- Data warehouses and dbt models
- Databricks and PySpark processing for large datasets
- Data cleaning, validation and quality checks
- Pipelines on AWS, GCP or Databricks
Why work with me:
- At Amazon, I cut pipeline processing time by 30% and removed 95% of manual data work through automation
- Databricks Certified Data Engineer
- Clean, documented, tested code that you fully own
- Clear communication and on-time delivery
How it works:
- Message me with your data sources and goal
- I will confirm scope and the right package
- You receive working code, documentation and a walkthrough
Not sure which package fits? Send me a message before ordering, and Ill reply quickly.
FAQ
What do you need from me to start?
Access to or samples of your data sources, the target destination (database, warehouse or files), and a short description of the expected output. Credentials can be shared securely after the order starts.
Which tools and platforms do you work with?
Python, SQL, PySpark, Apache Airflow, dbt, Kafka and Databricks, on AWS, GCP or PostgreSQL. If you use a different stack, message me first and I’ll confirm whether I can help.
Will I own the code?
Yes. You receive the full source code, documentation and setup instructions, and it’s 100% yours to use and modify.
Can you work with my existing pipeline or database?
Yes. I can extend, fix or optimise existing pipelines. Please share details before ordering so I can scope it correctly.
How do you keep my data secure?
I only use the access needed for the task, never share or store your data beyond the project, and can work with anonymised sample data if you prefer
What if my project doesn’t fit a package?
Send me a message with your requirements and I’ll create a custom offer that fits your scope and budget.

