Browse categories
Explore
Fiverr Pro
English
$
USD
I will build AWS data engineering pipelines using python, pyspark, sql and glue
Senior Data Engineer
I am a Senior Data Engineer with 6.5 years of experience specializing in SQL, Python, PySpark, and AWS Cloud. I have extensive expertise in building scalable ETL pipelines using AWS Glue, Redshift, an...
About this Gig
Are you looking for an experienced Data Engineer to build reliable and scalable data pipelines?
I will develop and optimize AWS data engineering, ETL/ELT, and data processing solutions using Python, PySpark, SQL, AWS Glue, S3, Redshift, Athena, and Databricks.
What I can help you with:
- AWS Glue ETL/ELT pipelines
- Python & PySpark data transformation
- AWS S3 data lake solutions
- SQL queries and optimization
- Amazon Redshift data warehousing
- Athena external tables and analytics
- Databricks & Delta Lake pipelines
- API and database data ingestion
- Data cleansing, transformation & validation
- ETL troubleshooting and performance optimization
- Batch data processing and incremental pipelines
I focus on writing clean, scalable, maintainable, and production-ready data solutions based on your business requirements.
Whether you need a new data pipeline, optimization of an existing workflow, or help troubleshooting your data engineering project, I can help.
Technologies: AWS | Python | PySpark | SQL | Glue | S3 | Redshift | Athena | Databricks | Delta Lake
Expertise:
CI/CD
•
Monitoring & Logging
•
Automation
Cloud provider:
Amazon Web Services
