d
danielkalleward

Daniel K

@danielkalleward

Senior Cloud Data Engineer Full Stack Data Analyst

United States
English
About me
I am a Senior Cloud Data Engineer and Full-Stack Data Analyst with extensive experience in Snowflake, AWS, and GCP. I specialize in building multi-source data pipelines and scalable software architecture to solve complex analytical hurdles. My background includes leading data quality initiatives and driving significant infrastructure cost savings through automated analysis and CI/CD optimization.... Read more

Skills

d
danielkalleward
Daniel K
Offline • 
Average response time: 1 hour

See my services

API & Integrations
I will integrate a rest API and automate data extraction with python
From$50 / projectMore details

Work experience

General_Electric

Lead Data & Analytics Engineer

General Electric • Full-time

Oct 2016 - Apr 2025 • 8 yrs 6 mos

• Designed and built multi-source data pipelines in Python, R, SQL, and Bash that unified data from GitLab, Kubernetes, and HP ALM APIs into consolidated analytics dashboards adopted by 500+ engineers, producing the program's chief intelligence platform via Snowflake, Airflow, and dbt, and expanding iteratively across 12+ platforms from 6 databases and 27 APIs over 5 years. • Reduced AWS infrastructure spending by $600K+ annually by automating the collection and analysis of Kubernetes configurations versus actual computational demand across 200 development environments and 10,000+ Docker containers, revealing over-provisioning across 65% of all micro-services and directly driving infrastructure right-sizing decisions program-wide. • Achieved 99.99% data pipeline reliability with creation of a fully automated, CI/CD-integrated data pipeline, logging over 1M sets of test results into HP ALM via REST API over 4 years while delivering audit-grade traceability that withstood every compliance review from program inception to completion. • Served as SME for 40+ engineers across four live production systems, debugging and resolving critical data pipeline issues using Python, R, Snowflake, Databricks, and serverless AWS stacks (S3, Lambda, Glue). • Engineered a Python-based CI/CD pipeline auditing system using GitLab APIs to scan ~530,000 pipeline instances across 70+ projects, 210+ pipelines and 2,000+ distinct jobs, surfacing job failure patterns for triage that elevated pipeline job success rates from 75% to 98% over 3 business quarters.