Senior Confluent Cloud Engineer
Spencer Rose is working with a leading specialty insurer is looking for a senior Confluent Cloud and Kafka platform engineer. You'll take ownership of the day-to-day health of its event streaming platform, on an initial 6-month contract with a good chance of extending.
This is an urgent, hands-on role. The team needs someone who has run Kafka in production. You'll keep the platform stable, triage issues quickly and fix problems at the root, not just patch them.
What you'll be doing
- Operating and maintaining the Confluent Cloud platform across all environments
- Triaging incoming platform tickets, prioritising by business impact and resolving them quickly
- Investigating and fixing incidents, carrying out root-cause analysis and preventing repeat issues
- Managing Kafka topics, partitions, connectors, schemas, access control and service accounts
- Monitoring platform performance, consumer lag, throughput, capacity and cost
- Supporting the data and engineering teams who produce and consume events on the platform
- Writing and maintaining platform standards, runbooks and operating procedures
Technical skills we're looking for
- Deep, hands-on Apache Kafka experience: brokers, topics, partitions, replication, consumer groups and offsets
- Confluent Cloud or Confluent Platform, including Kafka Connect, Schema Registry (Avro, Protobuf or JSON Schema) and role-based access control
- Production support: incident management, ticket triage, root-cause analysis and on-call or support rota experience
- Monitoring and observability tools, such as Datadog, Grafana, Prometheus, Splunk or Confluent's own metrics
- Infrastructure as code and automation, such as Terraform (including the Confluent provider), CI/CD pipelines and Scripting in Python, Bash or Java
- Cloud platform experience, such as AWS or Azure, including networking, private links and security
- Stream processing with ksqlDB, Kafka Streams or Flink is a plus
What you'll bring
- Senior-level experience operating Kafka platforms in production
- A proven track record of fixing complex platform issues under pressure
- Insurance industry experience is essential
- Specialty insurance or Lloyd's market experience is a strong advantage
- Clear communication with both technical and non-technical stakeholders