301 to 325 of 344 Kafka Jobs in London

pipelines Leading initiatives in infrastructure-as-code, CI/CD, and platform monitoring Enabling robust security practices across DevOps delivery teams Core Skills & Experience Strong experience with AWS MSK (Kafka) and secure AWS environments Proven production experience with Kubernetes, Docker, and Helm Proficiency with Terraform and CI/CD pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will … design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. … financial services environments You have expertise with AWS including Lake formation and transformation layers You have strong Python coding skills You have experience with real-time data streaming using Kafka You're collaborative and pragmatic with excellent communication and stakeholder management skills You're comfortable taking ownership of projects and working end-to-end You have a good knowledge More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will … design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You’ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. … financial services environments You have expertise with AWS including Lake formation and transformation layers You have strong Python coding skills You have experience with real-time data streaming using Kafka You’re collaborative and pragmatic with excellent communication and stakeholder management skills You’re comfortable taking ownership of projects and working end-to-end You have a good knowledge More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will … design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. … financial services environments You have expertise with AWS including Lake formation and transformation layers You have strong Python coding skills You have experience with real-time data streaming using Kafka You're collaborative and pragmatic with excellent communication and stakeholder management skills You're comfortable taking ownership of projects and working end-to-end You have a good knowledge More ❯

Senior Platform Engineer – Hybrid (London) – AWS/Kafka/Infrastructure as code (IaC) Location: Hybrid (2 days/week in London office) Type: Full-time, Permanent Salary: Competitive + Benefits About the Role We’re looking for a skilled Senior Platform Engineer to help shape and scale a modern cloud-native platform that underpins high-volume data processing. This … monitoring tools, and cost optimisation strategies. Mentor and coach engineers on platform best practices. Tech Stack Highlights AWS (ECS, S3, DynamoDB, Aurora, OpenSearch) Pulumi (TypeScript) for infrastructure as code Kafka (Confluent Cloud) for event-driven architecture GitHub Actions for CI/CD DataDog for observability Containerised microservices architecture What We’re Looking For Strong programming background (Java or TypeScript … preferred) Experience designing scalable, resilient cloud infrastructure Familiarity with event-driven systems and Kafka Hands-on experience with AWS and infrastructure automation tools (Pulumi, Terraform, etc.) Understanding of Domain-Driven Design and collaborative modelling Experience with relational and NoSQL databases (PostgreSQL, DynamoDB, OpenSearch) Bonus: Experience with monolith-to-microservices migrations Why Join? Flexible working (hybrid London) Enhanced holiday allowance More ❯

Senior Platform Engineer – Hybrid (London) – AWS/Kafka/Infrastructure as code (IaC) Location: Hybrid (2 days/week in London office) Type: Full-time, Permanent Salary: Competitive + Benefits About the Role We’re looking for a skilled Senior Platform Engineer to help shape and scale a modern cloud-native platform that underpins high-volume data processing. This … monitoring tools, and cost optimisation strategies. Mentor and coach engineers on platform best practices. Tech Stack Highlights AWS (ECS, S3, DynamoDB, Aurora, OpenSearch) Pulumi (TypeScript) for infrastructure as code Kafka (Confluent Cloud) for event-driven architecture GitHub Actions for CI/CD DataDog for observability Containerised microservices architecture What We’re Looking For Strong programming background (Java or TypeScript … preferred) Experience designing scalable, resilient cloud infrastructure Familiarity with event-driven systems and Kafka Hands-on experience with AWS and infrastructure automation tools (Pulumi, Terraform, etc.) Understanding of Domain-Driven Design and collaborative modelling Experience with relational and NoSQL databases (PostgreSQL, DynamoDB, OpenSearch) Bonus: Experience with monolith-to-microservices migrations Why Join? Flexible working (hybrid London) Enhanced holiday allowance More ❯

Senior Platform Engineer – Hybrid (London) – AWS/Kafka/Infrastructure as code (IaC) Location: Hybrid (2 days/week in London office) Type: Full-time, Permanent Salary: Competitive + Benefits About the Role We’re looking for a skilled Senior Platform Engineer to help shape and scale a modern cloud-native platform that underpins high-volume data processing. This … monitoring tools, and cost optimisation strategies. Mentor and coach engineers on platform best practices. Tech Stack Highlights AWS (ECS, S3, DynamoDB, Aurora, OpenSearch) Pulumi (TypeScript) for infrastructure as code Kafka (Confluent Cloud) for event-driven architecture GitHub Actions for CI/CD DataDog for observability Containerised microservices architecture What We’re Looking For Strong programming background (Java or TypeScript … preferred) Experience designing scalable, resilient cloud infrastructure Familiarity with event-driven systems and Kafka Hands-on experience with AWS and infrastructure automation tools (Pulumi, Terraform, etc.) Understanding of Domain-Driven Design and collaborative modelling Experience with relational and NoSQL databases (PostgreSQL, DynamoDB, OpenSearch) Bonus: Experience with monolith-to-microservices migrations Why Join? Flexible working (hybrid London) Enhanced holiday allowance More ❯

Senior Platform Engineer – Hybrid (London) – AWS/Kafka/Infrastructure as code (IaC) Location: Hybrid (2 days/week in London office) Type: Full-time, Permanent Salary: Competitive + Benefits About the Role We’re looking for a skilled Senior Platform Engineer to help shape and scale a modern cloud-native platform that underpins high-volume data processing. This … monitoring tools, and cost optimisation strategies. Mentor and coach engineers on platform best practices. Tech Stack Highlights AWS (ECS, S3, DynamoDB, Aurora, OpenSearch) Pulumi (TypeScript) for infrastructure as code Kafka (Confluent Cloud) for event-driven architecture GitHub Actions for CI/CD DataDog for observability Containerised microservices architecture What We’re Looking For Strong programming background (Java or TypeScript … preferred) Experience designing scalable, resilient cloud infrastructure Familiarity with event-driven systems and Kafka Hands-on experience with AWS and infrastructure automation tools (Pulumi, Terraform, etc.) Understanding of Domain-Driven Design and collaborative modelling Experience with relational and NoSQL databases (PostgreSQL, DynamoDB, OpenSearch) Bonus: Experience with monolith-to-microservices migrations Why Join? Flexible working (hybrid London) Enhanced holiday allowance More ❯

pipelines across Bronze ? Silver ? Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

Developer will design, develop, and implement data-intensive applications across the full engineering lifecycle. You'll architect and deliver microservices-based systems using Go (Golang), AWS, Kubernetes, Docker, and Kafka, working closely with cross-functional teams to build scalable, reliable, and resilient platforms. You'll also play a key role in optimising system performance, improving reliability, and ensuring scalability … including system design and architecture Background in complex, large-scale, data-driven applications Product-focused approach, ideally within fast-paced tech organisations (start-ups or scale-ups) Knowledge of Kafka, Cassandra, gRPC, and microservices is a strong advantage Open-source contributions are beneficial If you're a Senior Go Developer looking for a challenging 6-month contract with a More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

breaches in real-time and batch data. Build and scale high-volume data pipelines handling billions of daily events across distributed systems. Work with cutting-edge tech including Java, Kafka, Spark, Kubernetes, Clickhouse, Snowflake, Redis . Collaborate with quants, data scientists, and compliance experts to improve surveillance strategies. Contribute to system architecture for low-latency monitoring and high-throughput … Strong skills in Java (or similar: Kotlin, C#, C++) ; Python is a plus. Proven experience with real-time, low-latency systems and distributed data pipelines . Hands-on with Kafka, Spark, K8s, Clickhouse, Snowflake, and modern data architectures . Solid foundations in algorithms, system design, and optimisation . Curious, proactive, and comfortable working in a fast-moving, scaling environment. More ❯

quality, observability, scalability and security are embedded into high-quality, high-impact releases. You'll be working with a modern, cloud native tech stack using Java, Spring Boot, AWS, Kafka and CI/CD to build highly scalable, distributed systems with 24/7 availability. Location/WFH: There's a hybrid model with two days a week work … You have advanced experience of building cloud-native, distributed systems using Java and Spring Boot You have a strong knowledge of AWS including Amazon EKS You have experience with Kafka and event driven architectures You're collaborative and pragmatic with great communication skills, you're comfortable working with other teams and business stakeholders Apply now to find out more More ❯

quality, observability, scalability and security are embedded into high-quality, high-impact releases. You'll be working with a modern, cloud native tech stack using Java, Spring Boot, AWS, Kafka and CI/CD to build highly scalable, distributed systems with 24/7 availability. Location/WFH: There's a hybrid model with two days a week work … You have advanced experience of building cloud-native, distributed systems using Java and Spring Boot You have a strong knowledge of AWS including Amazon EKS You have experience with Kafka and event driven architectures You're collaborative and pragmatic with great communication skills, you're comfortable working with other teams and business stakeholders Apply now to find out more More ❯

Technical Data Lead Central London Up to 150,000+ Benefits My client is seeking a Technical Data Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading insurance firm in London. This role requires More ❯