Sampada - Data Engineer with 5+ years of expertise in cloud data architectures

Australind, Western Australia, Australiaen

Architected 10+ ETL pipelines processing 3TB+ daily, reducing data latency by 40%.

Led and mentored a team of 3 engineers; optimized AWS Glue workflows for 50% faster jobs and $36K savings.

Published on CazVid

Summary

Results-driven Data Engineer with over 5 years in designing and optimizing large-scale data pipelines, supporting business analytics and decision-making. Proficient in Cloud platforms like AWS and Azure, skilled in ETL development, data modeling, CI/CD, and team mentorship to deliver scalable data...

Key Achievements

Designed S3-Snowflake integration with star schema and SCD Type-2, decreasing query latency by 70%.

Skills

ETL Pipeline DevelopmentExpert

Built and optimized large-scale ETL pipelines for data ingestion and processing.

Cloud Data PlatformsAdvanced

Experienced with AWS and Azure services including Snowflake, Redshift, and Lambda for scalable data solutions.

Data Modeling & ArchitectureAdvanced

Designed star schemas and implemented SCD Type-2 dimensions for efficient data querying.

Automation & MonitoringAdvanced

Developed CI/CD pipelines and utilized CloudWatch for monitoring and alerting to ensure high system availability.

DataOps & Agile Methodologies

Experience

Sr. Data Engineer

Capgemini

December 2023 - Present

Architected 10+ ETL pipelines processing 3TB+ daily across multi-layer data lake (Landing/Raw/Curated/Archive), reducing data latency by 40%, Led and mentored team of 3 engineers, established AWS Glue optimization best practices achieving 50% faster job execution and $36K annual cost savings,...

Data Engineer

Capgemini

September 2022 - December 2023

Built event-driven workflows with Lambda, Step Functions, and Airflow, automating 60% of manual tasks (15 hours/week saved), Implemented CloudWatch monitoring with SNS alerts, reducing incident response time from 45 minutes to 5 minutes, Contributed to Agile sprints and CI/CD implementation,...