I will build python etl data pipelines and automate your data workflows
About this Gig
Need a reliable ETL pipeline or data workflow?
I will build a clean and scalable Python data pipeline to extract, transform, and load your data.
### What I can do
- Python ETL / ELT pipelines
- API, CSV, JSON & database integration
- Data cleaning and transformation
- SQL & database development
- Apache Airflow / NiFi workflows
- Data warehouse integration
- Automation and error handling
### Technologies
- Python
- SQL
- Airflow
- NiFi
- Spark
- AWS
- Snowflake
- BigQuery
- PostgreSQL
- MySQL
- dbt
- Airbyte
With 10+ years of data engineering experience, I focus on reliable, maintainable, and scalable solutions.
Please message me before ordering to discuss your requirements.
FAQ
What data sources can you work with?
I can work with APIs, CSV, JSON, Excel, SQL databases, NoSQL databases, and other structured data sources.
Can you connect my API to a database?
Yes. I can build a Python pipeline that extracts data from your API, transforms it, validates it, and loads it into your database.
Can you automate the pipeline?
Yes. I can use tools such as Apache Airflow to schedule and automate recurring data workflows.
Can you work with cloud data warehouses?
Yes. I have experience with AWS Redshift, BigQuery, Snowflake, ClickHouse, and other modern data platforms.
Can you work with large datasets?
Yes. I have experience designing data solutions for large-scale environments, including a data warehousing solution processing approximately 100TB of data daily.
Do you provide documentation?
Yes. Documentation can be included depending on the selected package.
Should I contact you before ordering?
Yes. Please send your data sources, target database/platform, expected workflow, and any existing code or documentation so I can recommend the appropriate package.
