Data Platform Architect & Integration Lead

Tasks

• Design, build, and deploy end-to-end integrations between Databricks data products and enterprise CRM platforms.
• Work hands-on with Delta Lake, Unity Catalog, PySpark, and Spark SQL for data consumption, transformation, and movement.
• Develop and implement scalable REST APIs and AWS-based data services and pipelines.
• Integrate customer, account, and product master data, ensuring accurate schema mapping, reconciliation, and change management.
• Apply AI in data engineering, integration, or software development contexts.
• Modernize legacy integrations using cloud-native architecture and ensure data quality, observability, error handling, and reliable data delivery.
• Lead the integration workstream while actively contributing to coding, code reviews, deployments, and troubleshooting.
• Collaborate with client stakeholders and cross-vendor teams to resolve defects, manage dependencies, and ensure successful delivery.

Requirements

• Hands-on experience with Databricks, Delta Lake, Unity Catalog, and Lakehouse/Medallion Architecture.
• Practical experience applying AI in data, integration, or software development.
• Strong experience building AWS-based data services and transformation pipelines.
• Expertise in REST API design, development, and implementation at scale.
• Strong hands-on skills in PySpark and Spark SQL.
• Experience with Master Data Management (MDM), particularly customer, account, and product master data integrations.
• Strong client communication, technical leadership, and cross-team collaboration skills.
• Candidates must demonstrate hands-on delivery experience across all the required technical skills.

Schedule

• Onsite

How to apply

• Share your profile.

Location

• Indianapolis, Indiana, USA