j
joamoll1

Joan M

@joamoll1

Senior Data Engineer

Spain
Spanish, Catalan, English
About me
I am a Senior Data Engineer at Gelato. I architected cloud-native data pipelines on GCP and AWS processing 10M+ daily events and terabytes of data. I pioneered AI-powered monitoring leveraging LLMs and MCPs for automated error detection.... Read more

Skills

j
joamoll1
Joan M
Offline • 

See my services

Data Warehouse
I will review your bigquery data warehouse and fix costs, performance and architecture

Work experience

Senior Data Engineer

Gelato • Full-time

May 2022 - Present4 yrs

- Architected cloud-native data pipelines on GCP and AWS processing 10M+ daily events and terabytes of data, reducing latency by 60% and improving processing throughput by 5x. - Engineered large-scale data processing with DBT on BigQuery, handling distributed computation of 500GB+ daily datasets with optimized partitioning, clustering and incremental strategies. - Pioneered AI-powered monitoring leveraging LLMs and MCPs for automated error detection and root cause analysis, with alerting notifications via email and Slack, reducing incident response time over 50%. - Migrated old replication to real-time streaming pipelines using CDC and Datastream, enabling immediate business insights. - Optimized data workflows reducing cloud compute costs by 70% through efficient resource allocation and query optimization.