Looks Like This Service Is On Hold

I will build scalable data pipelines with kafka, airflow, spark, bigquery and snowflake

Finland

I speak English, Chinese

Turn your Data into Actionable Insights with Power AI

With a strong background in Machine Learning and DataOps, I specialize in building and scaling intelligent systems that power business solutions. I have extensive experience in developing Large Langua...
About this Gig

Are you looking to streamline your data operations, implement real-time data streaming, or build robust cloud-based data architectures? You are in the right place!


I am a professional Data Engineer with expertise in designing, building, and optimizing modern, scalable data pipelines using the latest cutting-edge technologies. I specialize in turning raw data into actionable insights through efficient workflows and advanced tools.


What I Offer:


  • Real-time data ingestion and streaming with Apache Kafka, AWS Kinesis, Apache Nifi, Fivetran, and Airbyte.
  • Cloud storage and data warehousing with AWS S3, Google Cloud Storage, Azure Data Lake, Google BigQuery, Snowflake, and AWS Redshift.
  • High-performance distributed data processing using Apache Spark and Apache Flink.
  • Data transformation and automation with dbt (Data Build Tool) and Apache Beam.
  • Workflow orchestration and automation with Apache Airflow and Prefect.
  • Data monitoring and observability with Grafana, Prometheus, and DataDog.
  • Deployment and scalability through Docker and Kubernetes.
  • End-to-end data engineering and machine learning integration with Databricks.

Expertise:

API integration

Big data

Data manipulation

ETL

SQL

NoSQL

Technology:

Amazon Redshift

Azure data factory

BigQuery

Snowflake