I will build an automated data pipeline with python and airflow

Paul Eru

Nigeria

I speak English

Data and cloud engineer

I'm a data engineer who builds automated data pipelines that run on their own, locally or in the cloud. I work with Python, SQL, PostgreSQL, Apache Airflow, and Docker, etc and I've deployed a live pi...
Read More
About this Gig

Tired of copying and cleaning data by hand? I build automated data pipelines that collect your data, clean it, and store it in a database, running on a schedule by themselves.


What you get:

- Python code that pulls data from APIs or files

- Data cleaning (duplicates, wrong formats, missing values)

- Storage in a PostgreSQL database

- Daily scheduling with Apache Airflow

- Docker packaging so it runs the same everywhere

- AWS cloud server deployment (Premium package)


I have built and deployed a working pipeline like this myself, and I can share screenshots of it.


Before you order, message me your data source and what you want to do with the data, so I can confirm it fits.

Read More
build an automated data pipeline with python and airflow
Full Screen
build an automated data pipeline with python and airflow
Full Screen
Full Screen
build an automated data pipeline with python and airflowbuild an automated data pipeline with python and airflowbuild an automated data pipeline with python and airflow

Expertise:

API integration

•

Automations

•

Big data

•

Data extraction

+2 more

Technology:

Apache Spark

•

BigQuery

•

Python

•

SQL

•

Apache Airflow

My Portfolio

Related tags