Azure Databricks Engineer

Tasks

• Design and develop scalable data pipelines using Azure Databricks and PySpark.
• Build and optimize ETL/ELT workflows for large datasets.
• Integrate data from databases, APIs, data lakes, and streaming platforms.
• Develop and tune Spark jobs for performance and reliability.
• Implement data orchestration using Azure Data Factory (ADF).
• Work with Azure Data Lake Storage Gen2 (ADLS Gen2) and Delta Lake.
• Implement data quality, validation, monitoring, and governance.
• Follow CI/CD, security, and Azure DevOps best practices.

Requirements

• 10+ years of experience
• Azure Databricks
• PySpark, Spark SQL, and Python
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS Gen2)
• SQL Development & Query Optimization
• ETL/ELT Pipeline Development
• Data Warehousing & Dimensional Modeling
• Delta Lake & Medallion Architecture
• Git, Azure DevOps & CI/CD

Schedule

• 100% Onsite

How to apply

• Share your updated resume by email.

Location

• Minneapolis, MN
• Dallas, TX