b
b_anvitha

Anvitha B

@b_anvitha

Senior Data Engineer

Canada
English
About me
I’m a Data Engineer and Data Analyst with 8+ years of experience building scalable data pipelines, real-time data integration systems, and analytics solutions. I have worked with global organizations like Accenture and contributed to data-driven research initiatives in Canada. I specialize in Azure-based data engineering, ETL/ELT pipelines, and big data processing using PySpark, Kafka, and SQL. I help businesses transform raw data into reliable, actionable insights through efficient, high-quality data solutions.... Read more

Skills

b
b_anvitha
Anvitha B
Offline • 
Average response time: 1 hour

See my services

Data Engineering Consulting
I will provide data engineering consulting and build etl solutions
From$30 / projectMore details

Work experience

Accenture

Data Engineering Team Lead

Accenture • Full-time

Sep 2021 - Feb 2026 • 4 yrs 5 mos

● Designed and implemented an event-driven, low-latency data integration framework leveraging Kafka Connect (CDC), Azure Event Hub, and Azure Functions to ingest, validate, transform, and sync data across systems with fault-tolerant retry handling via failed-message queues. ● Strengthened Python expertise by developing a Data Acceptance Testing (DAT) automation tool to perform metadata validation and data quality monitoring across multiple data sources, leading ingestion services using Cognite SDK, generating daily analytical reports, and improving application usability through issue-trend and user-experience analysis. ● Implemented advanced data pipeline solutions, achieving a 30% increase in data processing speed by integrating real-time data ingestion and transformation for a U.S based technology and specialty materials company. ● Led data integration projects by interacting with different stakeholders with over 5 automation services, resulting in an 80% improvement in operational efficiency. ● Developed an automated service (DAT) to validate multiple data sources, incorporating metadata checks and ID-level quality monitoring, which ensured 100% data accuracy across the system. ● Enhanced data accessibility by integrating more than 10 unique sources into COGNITE Data Fusion, improving data flow efficiency by 40% with two advanced extractors. ● Streamlined data transformation & loading processes for an internal Accenture POC, achieving 30% efficiency gains. ● Designed and implemented a data integration framework leveraging Kafka Connect, Azure Event Hub, and Azure Functions to capture CDC-enabled tables, transform data, and seamlessly process it from source to target systems across Windows/Linux environments.

Tata_Consultancy Services

IT Analyst

Tata Consultancy Services • Full-time

Aug 2016 - Sep 2021 • 5 yrs 1 mo

● Boosted account satisfaction by 15% through tailored software solutions as a Java Developer for a multinational networking and telecommunications company. ● Revamped application maintenance protocols, including automation of system health checks, leading to a 15% improvement in overall system uptime metrics. ● Optimized the SW Gateway tool for secure software distribution, customizing features for global compliance. ● Spearheaded comprehensive testing frameworks for data pipelines, reducing data defects by 60% and boosting overall project efficiency by 70% across the team for a global telecommunications equipment provider. ● Led testing activities as Test Lead & Defect Manager, handling test analysis, design, test case creation, defect management, and root cause analysis while collaborating with Product Owners to ensure high-quality, on-time client deliverables