Browse categories
Explore
Fiverr Pro
English
$
USD
I will build pyspark and databricks data pipelines
Data Scientist
I am a Data Scientist working for a well-reputed Australian company based in Sri Lanka, where I develop data-driven solutions and AI-powered applications. I am currently working on Databricks-based pr...
About this Gig
Need help with your data pipeline?
I will build a clean and reliable PySpark and Databricks data pipeline based on your requirements.
What I can help with:
- PySpark data processing
- Data cleaning and transformation
- ETL/ELT pipelines
- Databricks notebooks and workflows
- Spark SQL
- CSV, JSON and Parquet data processing
- Data validation and basic optimization
What you will get:
- Clean and organized pipeline
- Well-structured PySpark code
- Source code included
- Easy-to-understand implementation
- Basic documentation when required
I can work with your existing data or help you build a pipeline from scratch.
Please message me before ordering if your project has specific requirements or a large dataset.
Technology:
Apache Spark
•
Excel
•
Python
•
SQL
•
Databricks
FAQ
What data formats can you work with?
I can work with common formats such as CSV, JSON and Parquet.
Do you work with Databricks?
Yes I'm a Databricks Certified Associate, I can build and work with PySpark pipelines and workflows in Databricks.
Can you clean and transform my data?
Yes, I can clean, transform and validate your dataset using PySpark.
Will I receive the source code?
Yes, source code is included according to the selected package
Can you work with my existing pipeline?
Yes, I can help improve, fix or extend an existing PySpark or Databricks pipeline.
Should I contact you before ordering?
Yes, please contact me if your project has specific requirements so I can confirm the scope before you order.
