I will build scalable databricks and pyspark etl data pipelines
Databricks Data Engineer, Azure Certified Architect, Data Expert, Cloud Security
About this Gig
Looking for a Senior Data Engineer to build high-performance data solutions? You are in the right place!
With 11+ years of enterprise experience and official cloud certifications, I specialize in designing robust data pipelines that process massive datasets with minimal latency and optimized cloud costs.
My Core Services:
* ETL/ELT Pipelines: Automated data ingestion from APIs, databases, and cloud storage.
* PySpark & SparkSQL: Modular Databricks notebooks for complex data cleansing and normalization.
* Performance Tuning: Debugging slow Spark jobs, query tuning, and cluster optimization.
* Data Warehousing: Implementing Medallion architectures and dynamic upsert logic.
Technical Stack:
Apache Spark | PySpark | Databricks | Azure Data Factory | Azure Synapse | Hive | SparkSQL | SQL Server
My Handoff Process:
1. Deep requirement analysis and architectural alignment.
2. Writing clean, production-ready code with testing.
3. Revisions and fine-tuning based on your feedback.
4. Detailed documentation and walkthrough.
Please message me via chat to discuss your requirements before placing an order!
Cloud provider:
Microsoft Azure
My Portfolio
FAQ
What language I code in?
Python on spark SQL on spark - I use Databricks instances to code.
Why do I take 7days to deliver?
The time actually varies with work complexity. I try to provide solutions as soon as possible. I can give solution within 2hrs if possible.
9 reviews for this Gig
| (9) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
L latenightmirage

United Arab Emirates
i am extremely happy with the result of the work he provided me with. the code was free of bugs and easy to understand. although i presented him with last minute work he was able to handle the time constraint. my only complaint would be it was a bit pricy, but other than that it was such a pleasure working...
$100-$200
Price
1 day
Duration
Helpful?B buntuspec

United States
Good attention to details and thorough debugging
$50-$100
Price
1 day
Duration
Helpful?M mrmiyagi24

United States
It was good working with TS.
$100-$200
Price
1 day
Duration
Helpful?A agbodikethomas
Repeat Client

United States
Professional
Up to $50
Price
5 days
Duration
Helpful?A agbodikethomas
Repeat Client

United States
Professional
$50-$100
Price
1 day
Duration
Helpful?
9 reviews for this Gig
| (9) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
L latenightmirage

United Arab Emirates
i am extremely happy with the result of the work he provided me with. the code was free of bugs and easy to understand. although i presented him with last minute work he was able to handle the time constraint. my only complaint would be it was a bit pricy, but other than that it was such a pleasure working...
$100-$200
Price
1 day
Duration
Helpful?B buntuspec

United States
Good attention to details and thorough debugging
$50-$100
Price
1 day
Duration
Helpful?M mrmiyagi24

United States
It was good working with TS.
$100-$200
Price
1 day
Duration
Helpful?A agbodikethomas
Repeat Client

United States
Professional
Up to $50
Price
5 days
Duration
Helpful?A agbodikethomas
Repeat Client

United States
Professional
$50-$100
Price
1 day
Duration
Helpful?

