I will automate your etl workflows with apache airflow
Senior Data Engineer, AWS Certified, Cloudera Spark Developer
About this Gig
Need your ETL jobs scheduled monitored and reliable instead of running manually?
I build Apache Airflow workflows that orchestrate data pipelines across databases APIs cloud storage warehouses and Spark or Python jobs.
What I can deliver:
- Airflow DAG design and implementation
- Python operators Bash operators sensors and task groups
- Retries SLAs alerts and failure handling
- Parameterized workflows and environment configs
- Integration with AWS S3 Glue EMR Redshift Snowflake Databricks and APIs
- Documentation and deployment guidance
Why work with me:
- 9 years as a Senior Data Engineer
- Production experience with ETL orchestration and cloud data platforms
- Strong Python SQL Spark AWS and warehouse background
- Clean code with practical monitoring and handoff notes
Please message me before ordering so I can confirm your source systems schedule dependencies and deployment environment.
Other Data Engineering Services I Offer
FAQ
Can you work with existing Airflow environments?
Yes. I can update existing DAGs or create new workflows for Composer MWAA self managed Airflow or other Airflow deployments.
