I will build scalable data pipelines using python, spark and etl and elt

Sri Lanka

I speak English

Full Stack Developer, Spring Boot, React and Keycloak SSO

Need a web app built, fixed or secured? I'm a Senior Software Engineer with 5+ years building production systems in Java, Python and React, including remote work for an Australian company. I help busi...
About this Gig

Are you looking for a reliable data engineer to build efficient and scalable data pipelines? I specialize in data engineering, ETL pipeline development, and data processing using Python, SQL, and Apache Spark.


I can help you design and develop ETL pipelines to extract, transform, and load data from multiple sources such as APIs, databases, and files. Whether you need data cleaning, transformation, automation, or big data processing, I will deliver optimized and production-ready solutions.


My services include building data pipelines, performing data transformation, integrating multiple data sources, and optimizing workflows for better performance. I also support workflow automation and scheduling for efficient data processing.


I focus on writing clean, scalable, and maintainable code while ensuring performance and reliability. With hands-on experience in real-world projects, I can handle both small tasks and complex data engineering solutions.


Please contact me before placing an order to discuss your requirements and ensure the best results.

Destination Platform:

Snowflake

•

Google BigQuery

Tools & Platforms:

Airbyte

•

Kafka Connect

My Portfolio