Lead Confluent Kafka Engineer

@ PB consulting
PB consultingpbconsulting.com

Lead Confluent Kafka Engineer

Universal City, Texas
Posted 3 days ago

About the job

A company seeking a Lead Confluent Kafka Engineer to manage Kafka platforms, troubleshoot, automate, and support various Kafka environments. The role involves team leadership, client interaction, and supporting cloud-based Kafka solutions.

Requirements

  • 10+ years IT experience
  • Experience with Confluent Kafka
  • Kafka troubleshooting skills
  • Automation with Terraform, CI/CD
  • Strong communication skills

Qualifications

  • Leadership experience
  • Kafka platform expertise
  • Client-facing skills
  • Team mentoring ability

Full job description

We are seeking a Lead Consultant – Confluent Kafka to lead Kafka platform administration, troubleshooting, maintenance, automation, and production support. The role requires strong Confluent Kafka expertise, client-facing communication, and team leadership experience.

Roles and Responsibilities
  • Administer and support Confluent Platform and Confluent Cloud environments.
  • Troubleshoot Kafka connectivity, consumer groups, consumer lag, serialization, permissions, and AVRO schema issues.
  • Monitor Kafka using Datadog, Prometheus, Conduktor, and related observability tools.
  • Manage Kafka components including Replicator, Connectors, ZooKeeper, and KSQL.
  • Automate Kafka administration using Terraform and CI/CD/DevSecOps practices.
  • Manage Kafka configurations, including users, ACLs, topics, connectors, and application configurations.
  • Perform platform upgrades, patching, certificate renewals, and vulnerability remediation.
  • Troubleshoot Kafka client applications built with Java, .NET, Python, and Spring Boot.
  • Maintain and execute DR runbooks in accordance with security and risk requirements.
  • Collaborate with product and application teams on releases, documentation, enhancements, and automation.
  • Coordinate with Confluent or cloud providers to resolve platform issues.
  • Lead and mentor team members and communicate effectively with clients and stakeholders.
  • Support AutoSys, including agent installation, maintenance, patching, upgrades, and service checkouts.
Required Skills & Experience
  • 10+ years of IT experience with strong Kafka platform experience.
  • Hands-on experience with Confluent Kafka / Confluent Platform / Confluent Cloud.
  • Strong Kafka administration, troubleshooting, and production support experience.
  • Experience with Kafka monitoring and observability tools such as Datadog, Prometheus, and Conduktor.
  • Experience with Terraform, CI/CD, and DevSecOps.
  • Strong understanding of Kafka security, ACLs, topics, connectors, schemas, and consumer groups.
  • Experience with DR, patching, upgrades, certificates, and vulnerability remediation.
  • Experience troubleshooting Java, .NET, Python, and Spring Boot Kafka applications.
  • Strong client-facing, team leadership, and communication skills.
Show full description