Azure Databricks Engineer

Tasks

• Design and develop scalable ETL/ELT pipelines using Azure Databricks.
• Build data processing solutions using PySpark, Apache Spark, Python, and SQL.
• Develop and optimize Databricks notebooks, jobs, workflows, clusters, and Delta Lake.
• Integrate on-premises databases such as SQL Server, Oracle, DB2, and Teradata with Azure.
• Work with Azure Data Factory (ADF), ADLS Gen2, Azure SQL, and Azure Synapse.
• Implement Unity Catalog, data governance, security, and data quality frameworks.
• Optimize Spark performance and support production data pipelines.
• Implement CI/CD using Azure DevOps and Git.

Requirements

• 5+ years of Data Engineering experience with strong hands-on Databricks expertise.
• Azure Databricks, PySpark, Apache Spark, Python, and SQL.
• On-premises database integration and cloud data migration.
• Delta Lake, ADLS Gen2, and Azure Data Factory.
• ETL/ELT, data warehousing, and Lakehouse architecture.
• Git, Azure DevOps, CI/CD, and performance tuning.
• Preferred: Microsoft Fabric, Azure Synapse, Snowflake, Kafka/Event Hubs, Terraform, Unity Catalog, and Medallion Architecture.

Schedule

• 100% Onsite
• Contract

How to apply

• Share your updated resume.

Location

• Minneapolis, MN