I will build automated data pipelines and data engineering

India

I speak English

Data Engineer

I am a Software, Data, and Low-Latency Systems Engineer passionate about building high-performance infrastructure where speed, reliability, and data accuracy are critical. My primary focus is on real-...
About this Gig

Are you struggling with scattered data, broken pipelines, or slow databases? I am here to help you build resilient and scalable Data Engineering solutions.

As a Senior Data Engineer, I specialize in building robust ETL/ELT pipelines, designing Data Warehouses (Snowflake, BigQuery), and setting up real-time streaming infrastructure.

What I offer in this Gig:

  • Custom Data Pipelines: Automated extraction from APIs, CRMs, or legacy databases into your Data Warehouse.
  • Modern Data Stack: Expertise in Python, Go (Golang), and Advanced SQL for heavy data transformation.
  • Big Data & Streaming: Real-time event streaming using Apache Kafka, NATS, and processing millions of rows using Apache Parquet and DuckDB.
  • Cloud Infrastructure: Deployment and orchestration on AWS, GCP, or Linux VPS to ensure your pipelines run 24/7 without crashing.

Whether you need a simple Python script to scrape API data or a massive enterprise-grade Data Lake architecture, I deliver highly optimized and cost-effective solutions.

(Please send me a message before placing an order to discuss your data sources and architecture requirements!)

Destination Platform:

Snowflake

Databricks Lakehouse

ClickHouse

Tools & Platforms:

AWS Glue DataBrew

Google Cloud Dataflow