1 to 25 of 362 Kafka Jobs

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

code (Terraform, Helm) Experience integrating process automation with case-management or service-orchestration platforms Understanding of event-driven design and message brokers ( e.g. Kafka, RabbitMQ) Understanding of agentic AI capabilities and how they can complement workflow automation Experience contributing to open-source Camunda extensions Holds UK security clearance What ...

delivery experience. CI/CD pipelines using Jenkins, GitHub Actions, or similar. Desirable Skills AWS or other cloud platform experience. Docker and Kubernetes. Apache Kafka or event-driven architectures. Infrastructure as Code (Terraform, CloudFormation). Experience working on government or public sector projects. Knowledge of GDS standards and accessibility ...

their output, and maintain quality over AI‐generated work product. Experience building event‐driven and distributed systems , including familiarity with messaging platforms (e.g., Apache Kafka), delivery guarantees, and resilience strategies. Strong SDLC practices : version control, CI/CD pipelines, automated build/test/deploy workflows, and code quality ...

.NET in enterprise environments. Frontend development experience using React . Experience with Azure Functions, Azure Service Bus, Event Grid, or Event Hubs. Exposure to Kafka or other messaging technologies. Knowledge of Infrastructure as Code (Terraform or Bicep). Experience with observability platforms such as Prometheus, Grafana, or Azure Monitor. ...

Cloud, Spring Security, and Spring Data. Proven experience in designing and building microservices and highly distributed systems. Deep understanding of architectural and scaling patterns: Kafka and scaling, message brokers, guaranteeing message order, and idempotency. Saga Pattern: practical application of distributed transactions for eventual consistency across microservices. CQRS: understanding ...

Proficient in shift-left testing using tools like JUnit, Cucumber, Gherkin, PACT, and Test Containers.* Working knowledge of event/message brokers such as Kafka and MQ.Advanced Scala programming* **Strong proficiency in both functional and object‐oriented programming paradigms**, with the ability to apply the right approach to deliver ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

Java and Kotlin. Proven experience developing applications using Spring Boot. Strong understanding of microservices architecture. Experience designing and building REST APIs. Commercial experience with Kafka or similar messaging technologies. Experience with PostgreSQL. Experience working with AWS cloud services. Hands-on experience with Docker and containerised applications. Strong understanding ...

Agile delivery teams. Strong problem-solving and communication skills. Desirable Skills Experience with AWS cloud services. Knowledge of Docker and Kubernetes. Experience with Kafka or other messaging technologies. Familiarity with Terraform or Infrastructure as Code. Experience using Maven or Gradle. Previous experience working within UK Government or other public ...

Infrastructure AWS (preferred) Azure or GCP Docker or Podman Kubernetes Software Engineering Microservices Serverless architectures REST APIs and/or gRPC Event-driven systems (Kafka, MQTT) DevSecOps Git CI/CD (GitLab or similar) Infrastructure as Code (Terraform, Ansible or Puppet) Linux and Shell Scripting Just as importantly ...

Infrastructure AWS, Azure, GCP, VMware Cloud Foundation Kubernetes and Helm Containerisation technologies Linux and Windows administration Data & Integration Elastic MySQL/MariaDB SQL Server Kafka NiFi Security Security by Design Zero Trust IAM, OAuth/OIDC Keycloak HashiCorp Vault TLS/SSL and PKI What We're Looking ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

optimise CI/CD pipelines, ensuring automated testing and deployment. Architecture Contribution: Contribute to event-driven and distributed system designs using technologies like Kafka or Event Hub. Mentorship: Guide junior developers and foster a collaborative atmosphere within a cross-functional agile team. Why Join Us? Work on innovative projects ...

systems, storage, networking). Global financial services and regulatory/compliance considerations relevant to workload deployment. Database and messaging technologies such as MySQL, Cassandra, Kafka, CockroachDB, or Oracle. What\'s in it for you? You\'ll be building at the leading edge of AI-assisted software engineering ...

systems, storage, networking). Global financial services and regulatory/compliance considerations relevant to workload deployment. Database and messaging technologies such as MySQL, Cassandra, Kafka, CockroachDB, or Oracle. What's in it for you? You'll be building at the leading edge of AI‐assisted software engineering ...

industry experience. Experience with high‐volume, low‐latency SaaS systems. Experience with distributed and event‐driven architectures (Azure Service Bus, Event Hubs, Event Grid, Kafka). Experience building multi‐tenant architectures, including tenant provisioning, routing and per‐tenant configuration/quota management. Experience with Azure ingress and global routing ...

highly experienced Platform Architect to lead the architecture, governance, modernization, and operational excellence of enterprise‐scale Data and Integration Platforms across Snowflake, Confluent Cloud Kafka, Azure Cloud, GitHub Actions CI/CD, Kubernetes, Data Mesh, and broader integration ecosystems. The ideal candidate will combine deep technical expertise with strategic … event‐driven architecture using Confluent Cloud. Define topic governance, schema management, security controls, HA/DR, and cluster strategy. Establish enterprise integration patterns using Kafka, Kafka Connect, APIs, and streaming architectures. Define and implement CI/CD standards using GitHub Actions. Drive Infrastructure‐as‐Code, automation, release governance ...

models. • Expertise in developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models. • Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, TensorFlow, Triton, AWS services, and containerized environments (Docker, K8s). • Skilled in Unix/Shell or Python scripting, using scheduling tools like ...

background in designing scalable, high‐performance systems. Desirable Experience in the gaming industry or large‐scale interactive systems. Familiarity with messaging systems such as Kafka, RabbitMQ or similar Proficiency with monitoring tools like Prometheus, Grafana, or ELK Stack Experience with AI/ML integration in backend systems. Why Join ...

strategies, load balancing, and resource scheduling algorithms Experience building high‐throughput, low‐latency systems with sub‐100ms response time requirements Familiarity with message queues (Kafka, RabbitMQ), databases (PostgreSQL, Redis), and event‐driven architectures Knowledge of GPU computing, model serving optimizations (batching, quantization, multi‐tenancy), and resource allocation Experience with ...

metrics, traces, performance analysis. Proven ability to write clean, testable, well‐structured production code. Qualifications – Nice to Have Experience with streaming or queuing systems (Kafka, Pub/Sub, SQS). Familiarity with AI/LLM systems (AOE integration), though not required across all charters. Knowledge of data engineering patterns ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...