1 to 25 of 128 Kafka Jobs in London

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

Infrastructure AWS, Azure, GCP, VMware Cloud Foundation Kubernetes and Helm Containerisation technologies Linux and Windows administration Data & Integration Elastic MySQL/MariaDB SQL Server Kafka NiFi Security Security by Design Zero Trust IAM, OAuth/OIDC Keycloak HashiCorp Vault TLS/SSL and PKI What We're Looking ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

development experience with Python and/or Java. Expertise in AWS, Docker, ECS/EKS (Kubernetes), and cloud-native microservices. Experience with Apache Kafka and event-driven architectures. Strong knowledge of GitLab CI/CD, Terraform, Infrastructure as Code, and Continuous Delivery. Proven ability to establish engineering standards, improve ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

highly experienced Platform Architect to lead the architecture, governance, modernization, and operational excellence of enterprise‐scale Data and Integration Platforms across Snowflake, Confluent Cloud Kafka, Azure Cloud, GitHub Actions CI/CD, Kubernetes, Data Mesh, and broader integration ecosystems. The ideal candidate will combine deep technical expertise with strategic … event‐driven architecture using Confluent Cloud. Define topic governance, schema management, security controls, HA/DR, and cluster strategy. Establish enterprise integration patterns using Kafka, Kafka Connect, APIs, and streaming architectures. Define and implement CI/CD standards using GitHub Actions. Drive Infrastructure‐as‐Code, automation, release governance ...

expertise in designing large-scale machine learning systems and architectures Advanced programming skills (Python preferred) with experience in frameworks and tools such as JavaScript, Kafka, and reactive systems Extensive experience with cloud-based development, particularly on Azure, including AI/ML services and data platforms Proven experience with Kubernetes ...

modern Java (ideally Java 21), Spring Boot and relational databases. Event-Driven Systems : Experience with event-driven architectures and publish-subscribe systems such as Kafka or AWS SNS/SQS. Quality Mindset : A focus on writing well-tested, maintainable and observable code. DevOps & Cloud : Familiarity with CI/ ...

tooling (e.g., GitLab CI, GitHub Actions, Jenkins) and Containers (Docker) . Desirable: Experience with TypeScript . Knowledge of Microservices and Event-Driven Architecture (e.g., Kafka, SNS/SQS, EventBridge). Cloud platform experience, particularly AWS . Familiarity with Kubernetes . Familiarity with Node.js performance tuning and observability tooling (e.g. ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

asynchronous processing, message queues, and distributed systems Demonstrated ability to write clean, well-tested, maintainable code Bonus Familiarity with real-time data processing frameworks (Kafka, Redis Streams, etc.) Experience with ML/AI infrastructure or building tools for AI applications Previous work on developer tools, monitoring systems, or security ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...

Spring Batch and Spring Integration Experience building microservices and RESTful APIs Strong SQL skills and experience with Oracle Experience with messaging technologies such as Kafka or RabbitMQ Familiarity with Git, JUnit, Unix/Linux and shell scripting Exposure to cloud platforms (AWS, Azure or GCP) and CI/ ...

skills Good communication and collaboration ability Attention to detail and quality mindset Preferred Qualifications AWS Certified (Developer or Cloud Practitioner) Experience with: Streaming platforms (Kafka/MSK) Performance and security testing tools Exposure to enterprise-scale AWS modernization programs ...

Java, we use other languages, too, so a willingness to learn them would be encouraged. Event architecture: Exposure to publish-subscribe technologies such as Kafka, RabbitMQ or SNS/SQS Testing skills: Experience in writing well-tested code. Coaching and Development: Nurturing talent by empowering and guiding individuals ...

Boot for building microservices. Strong expertise with relational databases (Oracle) and data modelling (canonical data models, JSON). Deep experience with enterprise messaging platforms (Kafka, IBM MQ). Proven experience implementing AI/ML solutions (using Python or other frameworks) to solve business problems. Full‐stack development experience (RESTful ...

frameworks Java, Go, C#, Rust, or other strongly typed languages Internal platform engineering or developer platform ownership Event-driven architectures using EventBridge, Kinesis, Kafka, SQS, or SNS Contact centre, voice, or AWS Connect environments What's on Offer Remote-first working across the UK Exposure to large-scale cloud ...

with DevOps & CI/CD tools like GitHub, Terraform, Docker, Kubernetes, and automated testing and monitoring Skilled in data modelling, APIs, messaging systems (e.g., Kafka), and ETL pipelines Knowledge of secure design, identity management, and regulatory standards (e.g., GDPR) Architecture certifications (e.g., TOGAF, ArchiMate) are a plus ...

collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable and operationally mature, with strong monitoring, logging ...

Data Engineering and Analytics: Work closely with data teams to define robust data pipelines and scalable cloud-based data platforms using tools like Apache Kafka, Snowflake, or Databricks. Monitoring and Performance Tuning: Implement advanced monitoring and observability solutions using tools like Prometheus, Grafana, or Datadog to proactively identify ...

e.g., Airflow, Databricks Workflows) Strong understanding of data modelling and lakehouse architecture Databricks certifications (e.g., Databricks Certified Data Engineer) Experience with streaming data pipelines (Kafka, Structured Streaming) Experience with CI/CD and DevOps practices Knowledge of Delta Lake features (time travel, CDC, optimisation) Experience with containerisation (Docker, Kubernetes ...

legacy syste ms.Strong expertise in Camunda Platform 8/7, BPMN 2.0, D MN.Hands‐on experience with Java/Spring Boot, REST APIs, Kafka, cloud-native microservic es.Strategically support cloud migration and modernization programs involving Camun da.Conduct POCs, evaluate tools, and propose scalable architecture improvemen ts.Mentor technical teams ...