Data QA Engineer

Tasks

• Perform data quality assurance and testing for healthcare applications.
• Validate data pipelines, transformations, and ETL processes.
• Develop and execute test automation using Python, PySpark, and SQL.
• Test Azure Data Factory pipelines, monitoring, and CI/CD processes.
• Validate data across Bronze, Silver, and Gold layers.
• Ensure data accuracy, completeness, consistency, and integrity.
• Validate reporting-layer data using Power BI and Tableau.
• Support data governance and quality processes using Collibra.
• Collaborate with Agile teams to maintain high-quality development standards.

Requirements

• 8+ years of experience in Data QA / Data Testing.
• Minimum 3 years of experience in the Healthcare Payer domain.
• Strong hands-on experience with Azure Databricks.
• Experience with Azure Data Factory and data pipeline testing.
• Strong proficiency in Python, PySpark, and SQL.
• Experience testing Lakehouse architecture and medallion data patterns.
• Strong communication and cross-functional collaboration skills.
• Azure Databricks
• Python
• PySpark
• SQL
• Collibra
• Healthcare Payer domain
• Databricks Workflows
• Delta Lake
• Delta Live Tables (DLT)
• Unity Catalog
• Lakehouse architecture
• Medallion architecture
• Preferred: Power BI
• Preferred: Tableau
• Preferred: Collibra / Data Governance
• Preferred: Azure Data Factory CI/CD
• Preferred: Healthcare claims and payer data testing
• BE / ME / B.Tech / M.Tech / B.Sc. / M.Sc. in a technical field.

Schedule

• Hybrid – 3 days per week onsite at the Philly office

How to apply

• Submit a resume.

Location

• Philadelphia, PA