s
sultan_bgs

Sultan

@sultan_bgs

Certified Data Engineer

India
English
About me
Results-driven Data Engineer with 4.5 years of experience in designing, developing, testing, supporting and optimizing scalable ETL/ELT pipelines using PySpark, Databricks, SQL, Python, Apache Spark and cloud-based data platforms. Skilled in Databricks Data Engineering, workflow automation, data integration, and performance optimization across Retail and Pharma domains. Experienced in collaborating with cross-functional teams, gathering business requirements, performing root cause analysis, and ensuring reliable data delivery through Agile development practices.... Read more

Skills

s
sultan_bgs
Sultan
Offline • 

See my services

Data ETLs
I will build robust and scalable data pipelines using pyspark, databricks, and airflow
From$50 / projectMore details

Work experience

Infosys

Data Engineer

Infosys • Full-time

Feb 2022 - Mar 2025 • 3 yrs 1 mo

Developed and optimized ETL/ELT pipelines using Databricks, Python (PySpark), AWS S3, Apache Airflow, and Snowflake for enterprise-scale data processing. Converted complex Teradata SQL procedures into optimized PySpark workflows to improve automation, scalability, and performance. Designed and implemented scalable Databricks workflows for data ingestion, transformation, and reporting solutions. Integrated multiple enterprise data sources and ensured reliable data delivery across downstream systems. Performed testing, validation, troubleshooting of data pipelines to ensure high data quality and system stability. Collaborated with business stakeholders, analysts, and cross-functional teams to gather requirements and deliver data-driven solutions. Enhanced workflow efficiency by modifying Informatica workflows and BTEQ scripts for region-specific business use cases. Managed role-based access controls (RBAC) and implemented secure data access mechanisms using Unity Catalog. Supported CI/CD deployment activities and participated in Agile-based software development practices.