I will build your etl data pipeline using python, sql and apache airflow
About this Gig
I build reliable, production-grade ETL/ELT pipelines that move and transform your data without errors or downtime. In my current role as a Data Engineer, I've engineered pipelines syncing billions of records between systems with real-time deduplication, full and delta sync, and zero data loss in production, and built Apache NiFi clusters handling continuous enterprise data integration.
Whether you need a simple script to move data from a CSV into a database, or a scheduled pipeline that pulls from an API and loads it into your warehouse, I will design it to be clean, documented, and easy to hand off to your team.
What I can help with: data extraction from APIs, databases, or files; transformation and cleaning; deduplication and upsert logic; scheduled and automated syncs; and migration between databases such as MySQL, SQL Server, and PostgreSQL.
I bring the same reliability I use in production systems supporting millions of users to every project here. Clear communication and clean, well-documented code are always part of the delivery.
Destination Platform:
PostgreSQL
•
MySQL
•
Microsoft SQL Server
Tools & Platforms:
Kafka Connect
•
Apache NiFi
FAQ
What information do you need from me to get started?
Send me your data source and destination details (databases, APIs, or files), the format of your data, and how often the sync needs to run. I'll take it from there.
Can you work with my existing AWS or Azure setup?
Yes, I regularly work with ADLS, S3, and other cloud storage and database services, and can integrate with your existing infrastructure.
Do you provide documentation for the pipeline you build?
Yes, every delivery includes clear documentation covering setup, configuration, and how the pipeline works, so your team can maintain it easily.

