1 to 25 of 134 Kafka Jobs in London

newly formed group focused on enabling and supporting real-time data capabilities across the organisation. This team provides foundational services such as Apache Kafka, Kafka Connect, Apache Flink, and other streaming technologies that power real-time applications and data flows. As a Senior Software Engineer … data systems. Our stack runs on AWS as a set of distributed applications using Kubernetes and a microservice-led architecture. We are also utilising Kafka for our streaming and PACT for Contract testing. What you'll get to do: Design, develop, and maintain streaming infrastructure and services using Kafka ...

communication and documentation skills. · Ability to work independently and lead cross-functional teams. · Adaptability to rapidly evolving technological environments PREFERRED SKILLS · Airflow, dbt, Spark, Kafka, RabbitMQ, Redis. · Git, CI/CD pipelines. · Experience with data warehousing solutions such as Snowflake, Redshift, BigQuery, or Synapse. · Exposure to AI/ ...

able to continuously research, evaluate, and implement new technologies to improve the platform Experience with event-driven architectures and message brokers (particularly Kafka) Strong knowledge of containerization, orchestration, and cloud deployment (Azure preferred) Proven ability to balance technical debt against delivery priorities Strong testing mindset with experience in automated ...

experience in building application using container-orchestration systems like Kubernetes, and container engines like Docker and in building real-time event streaming apps using Kafka, and RabbitMQ message broker Functional knowledge of programming scripting such as JavaScript, PowerShell, Python, Bash, SQL, .NET, Java, PHP, Ruby, PERL, C++ ...

platforms such as AWS, Azure, or GCP. Strong understanding of design patterns, SOLID principles, and domain-driven design. Experience with message brokers such as Kafka or RabbitMQ, and event-driven architectures. Excellent analytical skills and experience working in an Agile/Scrum environment. PHP development experience *Rates depend ...

experience with relational databases such as Oracle, PostgreSQL, or MongoDB. Proficiency in Redis for caching and in-memory storage solutions. Hands-on experience with Kafka for messaging and data streaming. Familiarity with Unix/Linux operating systems and scripting languages such as Shell and Python. Experience with job scheduling ...

MLOps tooling such as Kubernetes, Docker, MLflow, Airflow, Terraform, and CI/CD. Preferred Skills Data Streaming and Orchestration: Familiarity with tools such as Kafka, Flink, Spark, dbt, and Airflow. Multi-Modal LLM Systems: Experience with multi-modal LLM systems (text + image embeddings). AI Observability and Evaluation ...

latency. Perform benchmarking and profiling. Design and maintain microservices architectures. Implement service communication, load balancing, and observability. Work with message queues (e.g., Kafka, NATS, RabbitMQ). Deploy applications to cloud platforms (AWS, GCP, Azure). Use containerization tools (Docker) and orchestrators (Kubernetes). Implement CI/CD pipelines. Database ...

work What You'll Bring Expert Java (8/11/17+) Deep Spring Boot & microservices experience Strong AWS skills (EC2, S3, Lambda, IAM) Kafka/event-driven systems SQL optimisation REST/JSON API design Docker proficiency Excellent communication skills Nice to Have JavaScript/React Aurora/ ...

needs. We use ADRs as part of our decision-making process and our architecture is microservices running on Kubernetes with a heavy use of Kafka and even-driven design. Take ownership of tasks from the estimation stage right through until the release stage and post production Identify, troubleshoot ...

healthcare systems Docker, Kubernetes, CI/CD (Jenkins/GitLab/Azure DevOps) Cloud exposure (AWS/Azure/GCP) Knowledge of Kafka/RabbitMQ is a plus *Rates depend on experience and client requirements ...

teams within fast-paced environments. Deep expertise in: Python (Django, Flask, or FastAPI) PostgreSQL (design, optimisation, maintenance) Containerisation (Docker/Kubernetes) Event-driven architecture (Kafka/RabbitMQ) Desirable experience includes: TypeScript/JavaScript (NextJS, NodeJS, Tailwind) Terraform and DevOps practices Experience in building and scaling SaaS platforms in production. ...

teams within fast-paced environments. Deep expertise in: Python (Django, Flask, or FastAPI) PostgreSQL (design, optimisation, maintenance) Containerisation (Docker/Kubernetes) Event-driven architecture (Kafka/RabbitMQ) Desirable experience includes: TypeScript/JavaScript (NextJS, NodeJS, Tailwind) Terraform and DevOps practices Experience in building and scaling SaaS platforms in production. ...

cost-efficient scaling on GCP and Azure Solid understanding of SQL (PostgreSQL) and relational database design. Experience with event-driven systems (Pub/Sub, Kafka) and NoSQL databases (MongoDB). Nice to haves Familiarity with RAG, autonomous agents, and Model Context Protocol (MCP). Exposure to TDD, Agile ...

ideally PostgreSQL and DynamoDB). Familiarity with software design and architecture principles, including experience with APIs, microservices, event driven messaging and distributed systems (e.g. Kafka). Experience with cloud technologies (e.g. AWS) and modern software infrastructure tools. Excellent communication skills, able to present technical information clearly to non-technical ...

Azure) and containerisation (Docker/Kubernetes). Comfortable working with SQL and NoSQL databases . Experience with real-time data processing is a plus (Kafka, RabbitMQ, Redis, etc.). Excellent problem-solving skills, attention to detail, and team-oriented mindset . Bonus: Experience with sports analytics, distributed systems ...

advertising, eCommerce, or news Proficiency in Node.js, Go, Python, Java , and modern front-end frameworks AWS certifications, microservices/service mesh, and streaming tech (Kafka/Kinesis) If you're ready to solve hard problems , enjoy architectural freedom , and want to shape something foundational - let's talk. ...

advertising, eCommerce, or news Proficiency in Node.js, Go, Python, Java , and modern front-end frameworks AWS certifications, microservices/service mesh, and streaming tech (Kafka/Kinesis) If you're ready to solve hard problems , enjoy architectural freedom , and want to shape something foundational - let's talk. ...

advertising, eCommerce, or news. Proficiency in Node.js, Go, Python, Java, and modern front-end frameworks. AWS certifications, microservices/service mesh, and streaming tech (Kafka/Kinesis). If you're ready to tackle hard problems, enjoy architectural freedom, and want to shape something foundational - let's talk. ...

pick up new domain specific knowledge and understand the context of a project. Python, Scala, Java, or similar language. Experience with some of: Hadoop, Kafka, Spark, Docker, Ansible, Kubernetes, NiFi, Bash, GraphQL, HBase. building and deploying data pipelines into production. Software engineering concepts and best practices. Agile software development. ...

services Experience expressing system designs with C4 Modeling Knowledge of relational, NoSQL, and search databases (PostgreSQL, MySQL, MongoDB, Elasticsearch) and messaging systems (RabbitMQ, Kafka, NATS) Proficiency in continuous delivery, deployment pipelines, and automated testing practices Essential Soft Skills Exceptional communicator – able to simplify complexity for different audiences Trusted mentor ...

services including IaaS, ASE, AKS/ARO, VNets, App Gateway, Azure SQL/SQL Managed Instance/On-Prem SQL, Service Bus, Event Hubs, Kafka and Key Vault. Secure-by-Design: Strong background in architecture governance, design reviews, and change management. Demonstrated expertise in security-by-design, Zero Trust ...

Scientist Associate). • Experience with Azure Cognitive Services (e.g., Language, Vision, Speech) or Azure Bot Service. • Familiarity with streaming data processing frameworks (e.g., Apache Kafka, Azure Event Hubs, Azure Stream Analytics). • Experience with CI/CD pipelines (e.g., Azure DevOps, GitHub Actions). • Understanding of distributed computing concepts ...

/CD, automated testing, and version control Passion for data, analytics, and AI-driven problem solving Nice to Have: Cloud (AWS, GCP, Azure), Kafka/gRPC, React, Infrastructure as Code, ML/data processing experience Why Join? Work on greenfield data and AI initiatives Build scalable systems for millions ...

core of their global network. What You’ll Bring Strong experience with Java and Spring Knowledge of Reactive programming (e.g., Akka) Experience with Kafka or JMS Solid understanding of CI/CD pipelines , automation, and Agile delivery Experience working with MongoDB or other NoSQL databases What ...