I will build scalable data pipelines, etl workflows, and cloud data solutions
About this Gig
Are you struggling to manage messy raw data or streamline your data workflows? I'm here to help!
As an experienced Data Engineer, I specialize in designing and developing end-to-end data pipelines that are scalable, cloud-ready, and optimized for performance. I bring a deep understanding of transforming complex datasets into actionable business insights.
What I offer:
ETL/ELT pipeline creation (Batch & Streaming)
Cloud-based deployment: AWS Glue, Lambda, Azure Data Factory, Databricks, GCP Dataflow
Real-time processing using Kafka, Pub/Sub, or Event Hubs
API integration and cloud storage support
Data validation, cleaning, and quality assurance
Automation of data ingestion, transformation, and loading
PostgreSQL, NoSQL, Snowflake, Databricks integration
Tech Stack:
Python, SQL, Spark, PySpark, Apache Kafka, AWS, Azure, GCP, Databricks, PostgreSQL, NoSQL, Hadoop, Snowflake, and more.
Tools & Platforms:
Azure Data Factory
•
Other
