I will do big data work using spark, hive, kafka and cloud services

Bharath

India

I speak English

72 orders completed

Big Data Engineer at Amazon with 6+ years of experience in Hadoop, Spark, PySpark, Hive and Cloud platforms like AWS, GCP, Azure and DataBricks. Developed and scheduled highly efficient production ETL...
Read More
About this Gig

Senior Data Engineer at Amazon with 6+ years of experience in big data and Worked in various cloud platforms like AWS, GCP, Azure. Developed and scheduled highly efficient production ETL pipelines capable of handling on Terabytes of data.


Programming Skills

  • Python
  • Scala
  • SQL


Big Data Skills

  • Apache Spark (DataFrame and Datasets)
  • Apache Hive
  • Apache Airflow
  • Hadoop
  • PySpark
  • Apache Kafka
  • Delta lake
  • Databricks
  • HDFS
  • Spark streaming


Cloud Skills

  • AWS Redshift
  • AWS S3
  • AWS Lambda
  • EMR
  • EC2
  • Kinesis
  • RDS
  • GCP Compute cloud
  • Big query


Other Skills

  • Pandas (python-pandas)
  • MySql
  • Postgres
  • RestAPI


If you're looking for someone to build pipeline from scratch or enhance or improve performance of existing pipelines, you're just a ping away from accomplishing it.

Read More
do big data work using spark, hive, kafka and cloud services
Full Screen
do big data work using spark, hive, kafka and cloud services

Expertise:

Big data

•

Data flow

•

ETL

•

Transformation

•

SQL

•

NoSQL

Technology:

Amazon Redshift

•

Apache Hadoop

•

Apache Kafka

+3 more

Other Data Engineering Services I Offer

Related tags