Senior Integration Engineer

JOB PROFILESenior Data Integration Engineer Informatica IDMC · Cloud Data Integration & DatabricksExperience7 to 10 years
ROLE SUMMARYData integration engineer specialized in designing, developing, and operating enterprise data pipelines on ETL tools; Informatica IDMC (Intelligent Data Management Cloud / IICS) as the primary platform, with strong capabilities in feeding the Databricks Lakehouse. Able to work across cloud-agnostic environments (Azure, AWS, GCP) and to apply AI-assisted development with CLAIRE GPT and CLAIRE Copilot to accelerate the build cycle and reduce time-to-delivery.REQUIRED TECHNICAL SKILLSInformatica IDMC · Integration CoreCloud Data Integration (CDI): Mapping Designer, SQL ELT with pushdown optimization (full/source/target), Taskflows, mapping partitioning, Dynamic Mappings, parameterization, file listeners, intelligent structure models (CLAIRE-powered), and performance tuning.Cloud Mass Ingestion (CMI): batch and near-real-time ingestion from heterogeneous sources across its variants: Mass Ingestion Databases (CDC), Files, Applications, and Streaming.Cloud Application Integration (CAI): Process Designer, service connectors, guides, and business processes; API and microservices integration.PowerCenter to IDMC: migration and modernization of on-premises pipelines using structured methodology, CDI-PC, and migration accelerators.Platform operations: administration of Secure Agents and runtime environments (Secure Agent Groups), monitoring, and SLA management.Databricks IntegrationIDMC for Databricks: ingestion and ELT into the Databricks Lakehouse with CDI and Cloud Mass Ingestion, Delta Lake load patterns, and SQL ELT pushdown to Databricks SQL.Connectivity through the Databricks connector (Partner Connect), Unity Catalog awareness, and parameterized job orchestration.AI-Assisted Development (CLAIRE)CLAIRE GPT / CLAIRE Copilot: assisted generation of mappings, debugging of transformations, and automatic pipeline documentation through natural language within IDMC.Awareness of the new agentic capabilities (CLAIRE Agents, Fall 2025 release) for headless ingestion and transformation flows.Platform FinOpsUnderstanding of the IPU (Informatica Processing Units) consumption model and per-service cost optimization.Cloud-Agnostic (Complementary)Azure: Azure Data Factory (ADF), Data Lake Storage Gen2, Key Vault, Azure Databricks.AWS: Glue, S3, Step Functions, Redshift, Athena, EventBridge.GCP (desirable): BigQuery, Cloud Composer.IaC & CI/CD for pipelines: Terraform, CloudFormation; GitHub/Bitbucket, Jenkins.Databases & PlatformsAdvanced SQL (Oracle, SQL Server, PostgreSQL, Redshift, Databricks SQL).NoSQL (MongoDB, DynamoDB; desirable).Data Warehouse, Data Lake, and Lakehouse architecture patterns.CERTIFICATIONSInformatica Cloud Data Integration Developer, Professional Certification (ICP) (core to the role).Informatica Cloud Application Integration Developer, Professional Certification (desirable).Informatica IDMC Foundation / Data Engineering Foundation.Databricks Certified Data Engineer Associate (desirable).Microsoft Certified: Azure Data Engineer Associate (DP-203) (complementary).AWS Certified Data Engineer / Data Analytics Specialty (complementary).KEY RESPONSIBILITIESDesign and implement ingestion, transformation, and distribution pipelines with CDI and Cloud Mass Ingestion.Build and optimize ingestion and ELT into the Databricks Lakehouse using IDMC for Databricks and Delta Lake patterns.Migrate PowerCenter workloads to IDMC using structured methodology and internal accelerators.Operate and maintain integration infrastructure (Secure Agents, runtimes) on Azure and AWS under SLA standards.Apply CLAIRE GPT/Copilot to optimize the mapping development cycle and reduce delivery time.Monitor IPU consumption and propose cost and performance optimizations.