1 to 25 of 209 Kafka Jobs in London

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

code (Terraform, Helm) Experience integrating process automation with case-management or service-orchestration platforms Understanding of event-driven design and message brokers ( e.g. Kafka, RabbitMQ) Understanding of agentic AI capabilities and how they can complement workflow automation Experience contributing to open-source Camunda extensions Holds UK security clearance What ...

their output, and maintain quality over AI‐generated work product. Experience building event‐driven and distributed systems , including familiarity with messaging platforms (e.g., Apache Kafka), delivery guarantees, and resilience strategies. Strong SDLC practices : version control, CI/CD pipelines, automated build/test/deploy workflows, and code quality ...

Cloud, Spring Security, and Spring Data. Proven experience in designing and building microservices and highly distributed systems. Deep understanding of architectural and scaling patterns: Kafka and scaling, message brokers, guaranteeing message order, and idempotency. Saga Pattern: practical application of distributed transactions for eventual consistency across microservices. CQRS: understanding ...

Proficient in shift-left testing using tools like JUnit, Cucumber, Gherkin, PACT, and Test Containers.* Working knowledge of event/message brokers such as Kafka and MQ.Advanced Scala programming* **Strong proficiency in both functional and object‐oriented programming paradigms**, with the ability to apply the right approach to deliver ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

Java and Kotlin. Proven experience developing applications using Spring Boot. Strong understanding of microservices architecture. Experience designing and building REST APIs. Commercial experience with Kafka or similar messaging technologies. Experience with PostgreSQL. Experience working with AWS cloud services. Hands-on experience with Docker and containerised applications. Strong understanding ...

Infrastructure AWS, Azure, GCP, VMware Cloud Foundation Kubernetes and Helm Containerisation technologies Linux and Windows administration Data & Integration Elastic MySQL/MariaDB SQL Server Kafka NiFi Security Security by Design Zero Trust IAM, OAuth/OIDC Keycloak HashiCorp Vault TLS/SSL and PKI What We're Looking ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

optimise CI/CD pipelines, ensuring automated testing and deployment. Architecture Contribution: Contribute to event-driven and distributed system designs using technologies like Kafka or Event Hub. Mentorship: Guide junior developers and foster a collaborative atmosphere within a cross-functional agile team. Why Join Us? Work on innovative projects ...

systems, storage, networking). Global financial services and regulatory/compliance considerations relevant to workload deployment. Database and messaging technologies such as MySQL, Cassandra, Kafka, CockroachDB, or Oracle. What\'s in it for you? You\'ll be building at the leading edge of AI-assisted software engineering ...

systems, storage, networking). Global financial services and regulatory/compliance considerations relevant to workload deployment. Database and messaging technologies such as MySQL, Cassandra, Kafka, CockroachDB, or Oracle. What's in it for you? You'll be building at the leading edge of AI‐assisted software engineering ...

highly experienced Platform Architect to lead the architecture, governance, modernization, and operational excellence of enterprise‐scale Data and Integration Platforms across Snowflake, Confluent Cloud Kafka, Azure Cloud, GitHub Actions CI/CD, Kubernetes, Data Mesh, and broader integration ecosystems. The ideal candidate will combine deep technical expertise with strategic … event‐driven architecture using Confluent Cloud. Define topic governance, schema management, security controls, HA/DR, and cluster strategy. Establish enterprise integration patterns using Kafka, Kafka Connect, APIs, and streaming architectures. Define and implement CI/CD standards using GitHub Actions. Drive Infrastructure‐as‐Code, automation, release governance ...

strategies, load balancing, and resource scheduling algorithms Experience building high‐throughput, low‐latency systems with sub‐100ms response time requirements Familiarity with message queues (Kafka, RabbitMQ), databases (PostgreSQL, Redis), and event‐driven architectures Knowledge of GPU computing, model serving optimizations (batching, quantization, multi‐tenancy), and resource allocation Experience with ...

metrics, traces, performance analysis. Proven ability to write clean, testable, well‐structured production code. Qualifications – Nice to Have Experience with streaming or queuing systems (Kafka, Pub/Sub, SQS). Familiarity with AI/LLM systems (AOE integration), though not required across all charters. Knowledge of data engineering patterns ...

engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments would be highly advantageous Desirable experience includes: Databricks certifications Kafka or Structured Streaming CI/CD and DevOps practices Airflow or Databricks Workflows Delta Lake optimisation techniques Docker and Kubernetes Exposure to machine learning ...

without full visibility Help us move to our new systems from our legacy systems, paying down technical debt where it matters Support services including Kafka, Postgres (Aurora), MongoDB, and identity (Keycloak) Improve observability using tools such as Datadog to reduce firefighting over time Collaborate closely with engineers to make ...

Nice to Have: Experience defining and consuming APIs using Swagger/OpenAPI. Experience with Gradle and database migration tooling such as Liquibase. Knowledge of Kafka and event-driven architectures. If you're interested in this role, click 'apply now' to forward an up-to-date copy of your ...

tools such as Jenkins or Azure DevOps. Experience delivering scalable, high-quality digital solutions. Desirable Experience Consultancy, Government or NHS project experience. Knowledge of Kafka or other messaging systems. Knowledge of Helm. What's on Offer Competitive pension scheme. 25 days annual leave plus public holidays. Flexible benefits package ...

Java, Kotlin, or another JVM‐compatible language. Experience with relational databases, ideally Postgres, and NoSQL datastores such as DynamoDB. Knowledge of stream processing (e.g., Kafka). Building scalable web applications capable of handling tens of thousands of requests per second. DevOps culture and experience with Kubernetes or equivalent containers. ...

engineering internal developer platforms, core infrastructure systems, large monoliths, service extraction, or modernisation of legacy backend systems; eCommerce or marketplace platforms; event‐driven architectures (Kafka); AWS infrastructure (Terraform); data engineering; service‐to‐service authentication, internal platform security, or cloud cost management; enabling AI platform capabilities or safe‐AI guardrails. ...

Redshift or BigQuery. Experience with orchestration tools such as Airflow or Databricks Workflows. Previous experience working within Agile delivery environments. Desirable Experience Databricks certifications. Kafka or Structured Streaming. CI/CD and DevOps practices. Docker and Kubernetes. Exposure to Machine Learning pipelines. Experience within Financial Services or other highly ...

data modelling principles and Lakehouse architecture Excellent communication, stakeholder management and problem-solving skills Desirable experience includes: Databricks certifications Streaming technologies such as Kafka or Structured Streaming CI/CD and DevOps practices Docker and Kubernetes Exposure to machine learning pipelines Job Offer Competitive day rate ...

develop, and maintain scalable backend services, REST APIs, and microservices supporting the Personal Loans platform. Build and enhance event-driven, distributed application components, including Kafka-based integrations where applicable. Collaborate with product, architecture, engineering, QA, and delivery teams to clarify requirements and deliver business outcomes. Participate in technical design ...