Azure Databricks Engineer (Pyspark)

Tasks

• Lead the end to end migration of data pipelines, workflows, and integration patterns from Informatica to Azure Databricks.
• Assess current state Informatica assets and define target state architecture, migration strategy, and phased execution plans.
• Drive modernization of ETL patterns into scalable ELT and data engineering approaches aligned with Azure Databricks best practices.
• Analyze and interpret complex Informatica PowerCenter mappings, including transformations, lookups, joins, filters, routers, and expression logic, and build equivalent PySpark based pipelines in Azure Databricks.
• Assess Oracle database level stored procedures, functions, and packages that are invoked by or tightly coupled with Informatica workflows, and determine whether to migrate, refactor, or recreate that logic within Databricks using PySpark, Python, or Spark SQL.
• Provide technical leadership across solution design, engineering standards, code quality, testing strategy, deployment, and production readiness.
• Partner with business, product, architecture, infrastructure, security, and operations stakeholders to align migration outcomes with enterprise priorities.
• Establish migration success criteria covering data quality, reconciliat

Schedule

• 5 days onsite
• Day1 Onsite

Location

• Dallas, TX/ Atlanta, GA