Azure Databricks Engineer

About the role

We are looking for an experienced Azure Databricks Engineer with strong expertise in PySpark, ETL/ELT development, and Azure cloud data engineering to build and optimize scalable data pipelines.

Tasks

• Design and maintain scalable data pipelines using Azure Databricks and PySpark.
• Develop ETL/ELT solutions for structured and unstructured data.
• Integrate data from databases, APIs, data lakes, and streaming platforms.
• Optimize Spark jobs for performance and reliability.
• Implement data quality, monitoring, security, and governance best practices.
• Collaborate with stakeholders and resolve production data issues.

Requirements

• 10+ Years
• Azure Databricks
• PySpark, Spark SQL, Python
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS Gen2)
• SQL Development & Query Optimization
• ETL/ELT Pipeline Development
• Data Warehousing & Dimensional Modeling
• Delta Lake & Medallion Architecture
• Git, Azure DevOps & CI/CD
• Data Quality, Governance & Performance Tuning

Schedule

• 100% Onsite

How to apply

• Share your updated resume via DM or email.

Location

• Minneapolis, MN or Dallas, TX