Senior Data Engineer/Data bricks Specialist

Tasks

• Lead the architecture of data solutions leveraging Data bricks, including Delta Lake, Unity Catalog, and Medallion Architecture principles.
• Own end-to-end data engineering initiatives, providing technical direction and guidance to the development team.
• Design, develop, and review data pipelines to ensure scalability, maintainability, and engineering best practices.
• Improve workload efficiency and implement strategic measures to manage and reduce compute costs.
• Maintain robust standards for CI/CD, automated testing, monitoring, observability, and data governance.
• Partner with product owners and stakeholders to translate business needs into technical solutions while mentoring junior engineers.

Requirements

• Open only to U.S. Citizens and Green Card Holders.
• 8+ years in Data Engineering + 5+ years of hands-on production experience delivering Data bricks solutions.
• Strong expertise in PySpark and SQL.
• Real-time data solutions using Structured Streaming and/or Delta Live Tables.
• Hands-on experience with Unity Catalog, Terraform and/

Schedule

• Full-Time
• 100% remote flexibility (with a Washington, DC hub alignment).

Location

• Washington, DC (100% Remote)