Data Scientist/Data Engineer

Tasks

• Design, develop, and maintain batch and streaming data pipelines using Azure Databricks.
• Build data processing solutions using PySpark, Spark SQL, and Delta Lake.
• Implement Medallion Lakehouse Architecture (Bronze, Silver, and Gold layers).
• Develop and optimize dimensional data models and SQL workloads in Azure Synapse Analytics.
• Orchestrate and monitor data workflows using Databricks Workflows, Azure Data Factory, and Synapse pipelines.
• Implement data integration, transformation, and ETL/ELT processes.
• Apply data governance, security, and access controls to protect sensitive information.
• Support data quality, data stewardship, and data management standards.
• Collaborate with data architects, data scientists, analysts, and project managers.
• Prepare technical documentation, data flow diagrams, and solution designs.

Requirements

• Experienced with strong hands-on experience in Azure Databricks, PySpark, Spark SQL, Delta Lake, and Azure Synapse Analytics.
• Azure Databricks
• PySpark and Spark SQL
• Delta Lake and Medallion Architecture
• Azure Synapse Analytics
• Azure Data Factory (ADF)
• Batch and streaming data pipelines
• ETL/ELT and data integration
• Dimensional data modeling and SQL optimization
• Data governance and security
• Unity Catalog and role-based access control
• HIPAA, PHI, and PII data protection
• Row-level and column-level security
• Data quality and data stewardship
• Technical documentation and cross-functional collaboration
• Local candidates in Indianapolis, IN, or the surrounding Central Indiana area will be considered.

Schedule

• Hybrid

How to apply

• Share your updated resume.

Location

• Indianapolis, IN