Kafka Engineer/Administrator

Tasks

• Administer and support Kafka clusters across Cloudera, Confluent, and AWS MSK
• Manage topics, partitions, replication, retention, quotas, ACLs, and consumer groups
• Troubleshoot Kafka cluster health, consumer lag, ISR, performance, and broker issues
• Perform capacity planning, patching, upgrades, and reliability improvements
• Support the migration of Kafka workloads from on-prem to AWS MSK
• Build and maintain Kafka/MSK infrastructure using Terraform
• Manage deployments through GitLab CI/CD
• Implement automation and GitOps practices
• Monitor Kafka/MSK using Datadog
• Support TLS/SSL, SASL, IAM, RBAC/ACLs, and encryption
• Work closely with producer and consumer application teams
• Participate in incident response, RCA, and production support

Requirements

• Apache Kafka Administration – 4+ years preferred
• Cloudera and/or Confluent Kafka
• AWS MSK
• Terraform
• GitLab CI/CD
• Bash / Python scripting
• Kafka partitions, replication, ISR, offsets, consumer groups
• Kafka troubleshooting and performance tuning
• AWS: VPC, IAM, KMS, CloudWatch, PrivateLink
• Datadog monitoring and alerting
• Strong Linux and networking skills
• Excellent communication and collaboration skills
• Preferred / Nice to Have: MirrorMaker 2 / Confluent Replicator / Cluster Linking
• Schema Registry / Kafka Connect / ksqlDB
• Kafka Streams / Flink
• Kubernetes / EKS / Strimzi
• Confluent Certified Administrator
• AWS Solutions Architect / DevOps certification
• Large enterprise or regulated environment experience

Schedule

• Long-Term Contract
• Hybrid

How to apply

• 2 Video Interviews

Location

• St. Louis, MO / Denver, CO
• Possible Locations: Charlotte, NC / Atlanta, GA