Senior Kafka Engineer/Administrator

About the role

We are looking for a hands-on Kafka Engineer / Administrator to support enterprise Kafka platforms across on-premises Cloudera, Confluent Platform, and AWS Managed Streaming for Apache Kafka (AWS MSK).

The team is in the final stages of migrating Kafka workloads from on-premises environments to AWS.

Tasks

• Administer and support Kafka clusters across Cloudera, Confluent Platform, and AWS MSK.
• Manage topics, partitions, replication, retention, ACLs, quotas, and consumer groups.
• Troubleshoot consumer lag, under-replicated partitions, broker health, and performance issues.
• Support incident response, root-cause analysis, on-call activities, patching, and upgrades.
• Build and maintain infrastructure using Terraform and GitLab CI/CD pipelines.
• Support on-premises-to-AWS MSK migration and replication strategies.
• Monitor Kafka performance, consumer lag, and cluster health using Datadog.
• Work closely with producer and consumer application teams to improve reliability and performance.

Requirements

• Strong hands-on Apache Kafka administration experience in production.
• Experience with Cloudera and/or Confluent Platform.
• AWS MSK experience, including provisioning, configuration, IAM authentication, and networking.
• Strong Terraform and GitLab CI/CD skills.
• Experience with Datadog monitoring, dashboards, and alerting.
• Good understanding of Kafka partitions, rep

Schedule

• 6-month base contract with long-term extensions

How to apply

• Send your updated resume by email.

Location

• St. Louis, MO or Greenwood Village, CO