I will build etl pipeline, data cleaning, data enrichment

China

I speak English, Chinese

Data Engineer, ETL, APIs and BI Automation

Hi, I'm Jay — a Data Engineering and Automation Specialist with experience leading a team of 15+ Data Engineers. I help businesses build scalable data solutions, automated workflows, dashboards, and ...
About this Gig

What I Can Do

I help businesses automate, organize, and optimize their data workflows from collection to reporting.


My services include:

SQL query development and optimization

Automated data workflows and reporting systems

Batch data processing with scalable solutions

Real-time data processing and streaming pipelines

Data cleaning, transformation, and integration

API integration and automated data synchronization

Database and data warehouse design

Business reporting and dashboard solutions

Power BI and Tableau data visualization

End-to-end data automation solutions for startups and businesses


  • Experienced in migration of data from legacy systems (On-premise) and APIs to Azure Data Lake, performing complex transformations on data using DataBricks (Python and PySpark), moving the processed data to SQL Server / PostgreSQL / Data or Delta Lake.


  • Experienced in implementing scalable end-to-end optimized workflows on Azure Data Factory / Databricks to extract, process, and store data from diverse sources.

Technology:

Apache Hadoop

Apache Kafka

Java

Python

Scala

PowerShell

Expertise:

API integration

Data acquisition

Data extraction

My Portfolio

Other Data Processing Services I Offer