I will build automated data pipelines with python, sql and dbt

Nigeria

I speak English

Data and cloud engineer

I'm a data engineer who builds automated data pipelines that run on their own, locally or in the cloud. I work with Python, SQL, PostgreSQL, Apache Airflow, and Docker, etc and I've deployed a live pi...
About this Gig

Need your data collected, cleaned and kept up to date automatically? I build data pipelines that run on their own, so you always have fresh, trustworthy data.


WHAT I BUILD

- Extraction from APIs and files with Python

- Loading into PostgreSQL

- Cleaning and modeling with dbt, with data quality tests

- Daily automation with GitHub Actions, no server needed

- A live Streamlit dashboard you can open with a link and also to any final destination of your choice


PROOF IT WORKS

I built and run the Nigeria Data Jobs Tracker: it pulls job listings every day, cleans them with dbt and updates a public dashboard automatically.

Live demo: nigeria-job-market-tracker-c2dqzraz9ouopa9qo4cgnt.streamlit.app


HOW I WORK

- You tell me your data source and what you want to see

- I build the pipeline and hand over the code

- Tests run on every update, so bad data is caught before it reaches your dashboard


Tools: Python, SQL, PostgreSQL, dbt, GitHub Actions, Streamlit, Docker.


Message me before ordering with a short description of your data, and I will recommend the right package.


Expertise:

Automations

•

Data extraction

•

Data flow

•

Data validation

Technology:

Apache Kafka

•

Apache Spark

•

BigQuery

•

Python

•

Databricks

My Portfolio