I will build a databricks etl pipeline using pyspark and spark sql

India

I speak English

Data Engineer and AI Systems Builder, 10 Years Experience

Top Rated plus on Upwork: I'm Arun, I am a Data Engineer & AI Consultant with 9+ years of experience building scalable data platforms, analytics solutions, and AI applications. I specialize in ETL/E...
About this Gig

Do you need a reliable Databricks pipeline instead of fragile notebooks and manual data processing?


I am a data engineer with 9 years of professional experience building ETL pipelines, data platforms and analytics solutions. I work with Databricks, PySpark, Spark SQL, Delta Lake, Python and cloud data services to turn raw data into clean, analytics-ready datasets.

I can help you with:

  • Databricks notebooks using PySpark and Spark SQL
  • Batch ETL and ELT pipeline development
  • Bronze, Silver and Gold lakehouse architecture
  • Delta Lake tables, MERGE and incremental loads
  • Data cleaning, transformation and validation
  • Workflow and job configuration
  • Debugging and performance improvements
  • Clear code comments and technical documentation


You will receive maintainable source code, clearly defined pipeline logic and practical documentation for operating the solution.


Please message me through Fiverr before ordering the Premium package or any project involving production access, streaming, infrastructure setup, sensitive data or an urgent deadline.

Warehouse Platform:

Snowflake

•

BigQuery

•

Databricks

Project Type:

New Build

My Portfolio

Other Data Engineering Services I Offer