Senior Data Engineer (Machine Learning Enablement)
External job listingat BYTEBRIDGE TECHNOLOGIES
๐ข Weโre Hiring: Senior Data Engineer (Machine Learning Enablement) ๐ Location: Atlanta, GA (Occasional onsite visits to Midtown Atlanta) ๐ Duration: 6โ12 Months Contract ๐น Position Ov...
Salary
Not provided
Location
Atlanta, United States
Employment type
Full time
Workplace
Not provided
Senior Data Engineer (Machine Learning Enablement)
Atlanta, United States
Job description
๐ข Weโre Hiring: Senior Data Engineer (Machine Learning Enablement)
๐ Location: Atlanta, GA (Occasional onsite visits to Midtown Atlanta)
๐
Duration: 6โ12 Months Contract
๐น Position Overview
We are looking for a Senior Data Engineer with strong Azure data engineering and machine learning enablement experience to build scalable, cloud-native data platforms. The ideal candidate will have expertise in Azure data services, large-scale data processing, medallion architecture, and preparing high-quality datasets for machine learning models.
๐น Key Responsibilities
Design, develop, and optimize ETL/ELT pipelines using Azure Data Factory, Azure Databricks, Azure Functions, and Synapse Analytics.
Integrate external retailer and third-party datasets into Bronze, Silver, and Gold medallion architecture layers.
Profile datasets, resolve data quality issues, and manage missing, duplicate, or unmatched records.
Implement dimensional modeling, master data alignment, and reliable join strategies.
Execute large-scale, multi-terabyte data migrations with minimal downtime.
Transform complex semi-structured data, including XML, into analysis-ready formats.
Establish data governance, validation, quality controls, and feature-ready data models.
Collaborate with Data Science and ML teams to productionize machine learning models.
Maintain code quality, version control, documentation, and code reviews using GitHub.
๐น Required Skills
7+ years of experience in data engineering, platform development, or data architecture.
Strong hands-on experience with Azure Data Factory, Azure Databricks, Azure Functions, and Synapse Analytics.
Expertise in Python, SQL, PySpark, or pandas.
Experience with medallion architecture, dimensional modeling, and master data integration.
Strong understanding of data governance, data quality, ETL/ELT pipelines, and large-scale data processing.
๐น Preferred Skills
Exposure to AWS or GCP.
Salesforce integrations, APIs, data synchronization, or migrations.
Retail or consume