Browse categories
Explore
Fiverr Pro
English
$
USD
I will build and optimize your databricks pyspark pipelines on azure
Gig Summary
Databricks :: Azure :: Synapse :: PySpark :: Power BI :: SQL :: SSRS
Data Engineer with 10+ years of experience building reliable data pipelines and ETL solutions using Databricks, PySpark, and SQL, with deep expertise across Azure, AWS, and Synapse cloud environments....
Level 1
Has met certain performance criteria and shows strong potential in the marketplace.
About this Gig
Slow Databricks jobs, rising cluster costs, or a pipeline that keeps failing? I fix that.
I am a Senior Data Engineer with 8+ years of experience and a Databricks Certified Data Engineer Associate. I build and tune production pipelines on Azure Databricks for retail, finance, healthcare, e-commerce and travel clients.
What I deliver:
- PySpark and Spark SQL ETL jobs on Azure Databricks
- Delta Lake tables with a bronze, silver, gold layout
- Azure Data Factory orchestration and scheduling
- Performance tuning: partitioning, joins, caching, cluster sizing
- Data quality checks, unit tests and clear documentation
- Ingestion from SQL Server, REST APIs, files and Dynamics 365
How it works:
- You share the source, target and current problem.
- I confirm scope and timeline.
- You receive tested code, a run guide and a walkthrough.
AWS Databricks is also supported. Larger scope? Send a message for a custom offer.
Warehouse Platform:
Azure Synapse
•
Fabric Warehouse
•
Databricks
Project Type:
Optimization
My Portfolio
Other Data Engineering Services I Offer
FAQ
Do you have any task related to Data Engineering and dont know the possible solution?
I can discuss the solution as per your requirement on Zoom, MS Teams or any other platform. Please ping me, It will be my pleasure to serve you.
Do you need access to our Databricks or cloud environment?
Read-only or a sandboxed workspace is enough for most jobs. If write access is needed, I'll ask for temporary, scoped credentials only for the duration of the project.
Can you optimize existing PySpark jobs for cost and speed?
Yes. I review partitioning, cluster sizing, and job logic to cut runtime and compute costs, and provide a short report of the changes made.
Do you work on AWS as well as Azure?
Yes. Azure is my main platform, and I also deliver Databricks and PySpark work on AWS.
What if my project is bigger than the packages?
Send me a message with the sources, target and timeline, and I will reply with a custom offer scoped to your project.
Reviews
40 reviews for this Gig
| (40) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
Most relevant
N nexxta23
United States
Second time working with Atta. Very knowledgeable. Definitely will work with him again and recommend him.
$50
Price
1 day
Duration
Helpful?M 
millenborgeld
Germany
It was great!
$50
Price
1 day
Duration
A 
Seller's Response
Helpful?M missbrebre1
United States
Atta is extremely talented with writing TSQL queries on the fly. It’s always a pleasure working with him and I always learn multiple new things from him every single time.
$50-$100
Price
1 day
Duration
Helpful?I 
iankas
Switzerland
was very good. Rockstar in his field. Will definetly order again!
$400-$600
Price
1 day
Duration
A Seller's Response
Helpful?C 
craigread
United Kingdom
thanks for the help, knowledgeable, professional, quick, very good communicator, a pleasure to work with
$200-$400
Price
1 day
Duration
A Seller's Response
Helpful?
Reviews
40 reviews for this Gig
| (40) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
Most relevant
N nexxta23
United States
Second time working with Atta. Very knowledgeable. Definitely will work with him again and recommend him.
$50
Price
1 day
Duration
Helpful?M millenborgeld
Germany
It was great!
$50
Price
1 day
Duration
A Seller's Response
Helpful?M missbrebre1
United States
Atta is extremely talented with writing TSQL queries on the fly. It’s always a pleasure working with him and I always learn multiple new things from him every single time.
$50-$100
Price
1 day
Duration
Helpful?I iankas
Switzerland
was very good. Rockstar in his field. Will definetly order again!
$400-$600
Price
1 day
Duration
A Seller's Response
Helpful?C craigread
United Kingdom
thanks for the help, knowledgeable, professional, quick, very good communicator, a pleasure to work with
$200-$400
Price
1 day
Duration
A Seller's Response
Helpful?
