I will build real time streaming pipelines with apache kafka

Eric S

United States

I speak English

Senior Data Engineer, AWS Certified, Cloudera Spark Developer

I build production-grade data pipelines, cloud warehouses, and modern data stacks for startups and growing businesses. 9 years across banking, finance, retail, and hospitality — on AWS, GCP, Databric...
Read More
About this Gig

Need a real time data pipeline that moves events reliably from your applications databases or APIs into your analytics platform?



I build production ready streaming pipelines using Apache Kafka Kafka Connect Spark Structured Streaming AWS Kinesis Glue Databricks and cloud data warehouses.



What I can deliver:


- Kafka topic and producer consumer architecture


- Streaming ETL with Spark Structured Streaming or Python


- Kafka Connect or Debezium source connectors


- Data quality checks and schema validation


- Delivery into Snowflake BigQuery Redshift S3 or Databricks


- Monitoring documentation and deployment guidance



Why work with me:


- 9 years as a Senior Data Engineer


- Strong batch and streaming architecture experience


- Experience with AWS Databricks Snowflake and enterprise data platforms


- Clean handoff with code documentation and architecture notes



Please message me before ordering so I can confirm the event source target platform and expected throughput.

Read More
build real time streaming pipelines with apache kafka
Full Screen
build real time streaming pipelines with apache kafka

Destination Platform:

Snowflake

•

Google BigQuery

•

Amazon Redshift

+2 more

Tools & Platforms:

AWS Glue DataBrew

•

Google Cloud Dataflow

+3 more

Other Data Engineering Services I Offer

Related tags