Browse categories
Explore
Fiverr Pro
English
$
USD
I will build and optimize AWS glue etl data pipelines
About this Gig
Need a reliable AWS data pipeline built, fixed or optimized?
Im an AWS-certified Cloud and DevOps Engineer with hands-on experience designing enterprise data pipelines using AWS Glue, PySpark, Amazon S3, Amazon Redshift, Python, Terraform and GitHub Actions.
I can help with:
AWS Glue ETL job development and troubleshooting
S3 ingestion, partitioning and Parquet processing
PySpark transformations and schema handling
Redshift staging, loading, MERGE and deduplication
Timestamp conversion, backfills and incremental loads
Data-quality checks, validation and monitoring
Glue Catalog and crawler configuration
Terraform infrastructure and CI/CD deployment workflows
Pipeline performance and cost optimization
Root-cause analysis for schema and environment-specific failures
My experience includes building production pipelines for complex JSON data, flattening nested structures, applying latest-record logic, resolving type conflicts, and promoting controlled changes through development, testing and production environments.
Please message me before ordering if your pipeline has multiple sources, large backfills, complex schemas or production deployment requirements.
Destination Platform:
Amazon Redshift
•
Amazon S3
Tools & Platforms:
Other
My Portfolio
FAQ
Can you fix an existing AWS Glue job?
Yes. Share the script, error details, expected result, sample schema and relevant logs. Remove confidential data and credentials before sending anything.
Can you load data into Amazon Redshift or Amazon S3?
Yes. I can build or improve ETL flows that ingest, transform, validate and load data into Amazon S3 or Amazon Redshift.
Can you handle nested JSON, schema changes and backfills?
Yes. I can flatten nested JSON, manage schema and type conflicts, apply deduplication, and design controlled historical backfills.
Can you deploy the pipeline with Terraform and CI/CD?
Yes. The Standard or Premium scope can include Terraform and automated promotion workflows using GitHub Actions, depending on your environment.
