I will build robust etl pipelines data workflows in python and sql
About this Gig
Are manual data tasks slowing down your business, or do you need a reliable pipeline to move and transform data between databases, APIs, and cloud storage?
I build production-grade, automated ETL/ELT data pipelines, custom web scraping/ingestion scripts, and database workflows designed for reliability, speed, and maintainability.
Core Services Offered:
Custom ETL/ELT Pipelines: Automated extraction, transformation, and loading across APIs, databases, flat files (CSV/JSON/Parquet), and cloud storage.
Data Integration & API Ingestion: Connecting third-party APIs (REST/GraphQL), webhooks, and SaaS tools to centralized data warehouses or relational databases.
Database Design & SQL Optimization: Schema modeling, table indexing, query tuning, and automated migrations (PostgreSQL, MySQL, SQLite, Snowflake, BigQuery).
Workflow Automation & Orchestration: Scheduling and monitoring workflows using Python scripts, cron jobs, or Apache Airflow DAGs.
Data Cleaning & Preprocessing: Handling missing values, schema enforcement, deduplication, and structured formatting with Pandas/NumPy.
Data Extraction & Web Scraping: Clean, structured data extraction
