I will build your etl data pipeline using python, sql and apache airflow

India

I speak English

Data Engineer for ETL Pipelines, Python and SQL Automation

Data Engineer at Ksolves India Ltd., securing large-scale Big Data infrastructure powering production Hadoop clusters. I've architected a Redis high-availability layer supporting 5M+ concurrent users ...
About this Gig

I build reliable, production-grade ETL/ELT pipelines that move and transform your data without errors or downtime. In my current role as a Data Engineer, I've engineered pipelines syncing billions of records between systems with real-time deduplication, full and delta sync, and zero data loss in production, and built Apache NiFi clusters handling continuous enterprise data integration.


Whether you need a simple script to move data from a CSV into a database, or a scheduled pipeline that pulls from an API and loads it into your warehouse, I will design it to be clean, documented, and easy to hand off to your team.


What I can help with: data extraction from APIs, databases, or files; transformation and cleaning; deduplication and upsert logic; scheduled and automated syncs; and migration between databases such as MySQL, SQL Server, and PostgreSQL.


I bring the same reliability I use in production systems supporting millions of users to every project here. Clear communication and clean, well-documented code are always part of the delivery.

Destination Platform:

PostgreSQL

•

MySQL

•

Microsoft SQL Server

Tools & Platforms:

Kafka Connect

•

Apache NiFi

Related tags