Tech Lead – Microsoft Fabric & Databricks

About the role

Lead enterprise data engineering, platform architecture, governance, and cloud data solutions in the Oil & Gas industry.

Tasks

• Lead solution architecture, engineering standards, code reviews, technical mentoring, and delivery planning.
• Design and manage Microsoft Fabric, OneLake, Lakehouse, Warehouses, pipelines, notebooks, and semantic models.
• Architect Azure Databricks solutions using Delta Lake, Spark, PySpark, Python, SQL, and Medallion Architecture.
• Implement Unity Catalog for centralized data governance, security, access control, and data lineage.
• Administer SQL Server and Azure SQL, including performance tuning, backup, recovery, patching, and disaster recovery.
• Build scalable data ingestion and transformation pipelines integrating APIs, ERP systems, historians, telemetry, and operational data.
• Implement Azure security, identity management, Key Vault, networking, and compliance controls.
• Establish CI/CD, Git-based development, automated testing, Infrastructure as Code, and release management.
• Collaborate with business, engineering, operations, cybersecurity, and executive stakeholders.

Requirements

• 14+ Years experience.
• Microsoft Fabric & OneLake
• Azure Databricks & Unity Catalog
• Delta Lake, Apache Spark & PySpark
• Python, SQL & Data Engineering
• Lakehouse Architecture & Data Modeling
• SQL Server & Azure SQL Administration
• Data Governance, Security & Data Lineage
• Azure Cloud Security, Key Vault & Private Endpoints
• CI/CD, Git & Infrastructure as Code
• Technical Leadership & Solution Architecture
• Oil & Gas domain experience is required, preferably involving upstream, midstream, oilfield services, drilling, production, equipment

Location

• Houston, TX (Onsite)