Principal Engineer – Data Platforms (Microsoft Fabric)

About the role

Lead the architecture, development, and delivery of an enterprise-scale data lakehouse platform for a leading BioPharma client.

Tasks

• Lead the architecture and implementation of a Microsoft Fabric-based data lakehouse.
• Design and build scalable data ingestion pipelines using Fabric Data Factory, OneLake, and Spark.
• Establish medallion architecture (Bronze, Silver, Gold).
• Develop production-grade solutions using PySpark, Python, and T-SQL.
• Lead and mentor data engineers through code reviews and architectural guidance.
• Implement CI/CD and DevOps practices for data platforms.
• Build Power BI semantic models and self-service analytics capabilities.
• Establish data governance, security, quality monitoring, and platform SLAs.
• Collaborate with business stakeholders and external implementation partners.
• Support integrations with enterprise systems such as Veeva, LIMS, ELN, CTMS, ERP, and HRIS.

Requirements

• 10+ years of experience in Data Engineering, Data Platforms, or Data Architecture.
• 2+ years of technical leadership experience.
• Strong hands-on experience with Microsoft Fabric (Lakehouses, Notebooks, Data Factory, Deployment Pipelines).
• Strong proficiency in PySpark, Python, and T-SQL.
• Experience with Medallion Architecture (Bronze/Silver/Gold).
• Experience with Azure DevOps, GitHub Actions, CI/CD, and Infrastructure as Code.
• Knowledge of

Schedule

• Hybrid – 2–3 days onsite per week
• 6+ Months Contract-to-Hire

Location

• San Diego, CA