Senior Databricks AI Engineer

Design and develop scalable Databricks data platforms, lakehouse architectures, and data pipelines. Build ETL/ELT pipelines using Databricks, PySpark, SQL, Delta Lake, and Azure Data Factory. Develop and optimize Databricks notebooks, workflows, Delta Live Tables (DLT), and Unity Catalog. Integrate Azure AI services, Azure OpenAI, AI Search, and machine learning services into enterprise data solutions. Develop AI/ML pipelines for Generative AI, RAG, embeddings, document processing, and intelligent search use cases. Build and manage vector search solutions and integrate enterprise data with LLM-based applications. Implement data governance, security, access control, and monitoring using Unity Catalog and Azure services. Optimize Databricks workloads for performance, scalability, reliability, and cost. Collaborate with data scientists, AI engineers, architects, and business stakeholders to deliver production-ready solutions. Implement CI/CD and infrastructure automation using Azure DevOps, Git, Terraform, and Databricks Asset Bundles.