151 to 175 of 188 Kafka Jobs in the City of London

network API delays. Define and own the data contracts and pipelines that feed this "ground-truth" network data from the integration layer to our core AI Service Bus (Apache Kafka). Cross-functional Collaboration Work closely with the Scam Detection Service and AI/ML teams to define the feature vectors and data payloads needed from the network to … . Knowledge of (or deep, demonstrable curiosity about) telecommunications protocols and architectures. You must be comfortable talking to network engineers. Experience with high-throughput messaging or streaming platforms (e.g., Kafka, Pulsar). This is a permanent position with hybrid working of two days a week in the central London office and the rest WFH. The salary is very much More ❯

network API delays. Define and own the data contracts and pipelines that feed this "ground-truth" network data from the integration layer to our core AI Service Bus (Apache Kafka). Cross-functional Collaboration Work closely with the Scam Detection Service and AI/ML teams to define the feature vectors and data payloads needed from the network to … . Knowledge of (or deep, demonstrable curiosity about) telecommunications protocols and architectures. You must be comfortable talking to network engineers. Experience with high-throughput messaging or streaming platforms (e.g., Kafka, Pulsar). This is a permanent position with hybrid working of two days a week in the central London office and the rest WFH. The salary is very much More ❯

responsible for different application groups, building automation solutions, managing CI/CD pipelines, and implementing infrastructure-as-code . This role offers excellent exposure to cutting-edge technologies, including Kafka, Ansible Tower, and containerization platforms. The team values innovation and is open to adopting new tools based on the engineer's recommendations. This is an ideal opportunity for someone … thrives on learning new technologies and can integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower … with engineering teams, project managers, and suppliers on technical implementations Qualifications and Requirements: Strong scripting abilities (Python or PowerShell preferred; Bash or Perl also valued) Experience with streaming platforms (Kafka, Kinesis, or equivalent) Expert in CI/CD experience using Bamboo/Jenkins and BitBucket/GitLab Configuration management with Ansible (Ansible Tower is highly valued) SQL Server and More ❯

responsible for different application groups, building automation solutions, managing CI/CD pipelines, and implementing infrastructure-as-code . This role offers excellent exposure to cutting-edge technologies, including Kafka, Ansible Tower, and containerization platforms. The team values innovation and is open to adopting new tools based on the engineer's recommendations. This is an ideal opportunity for someone … thrives on learning new technologies and can integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower … with engineering teams, project managers, and suppliers on technical implementations Qualifications and Requirements: Strong scripting abilities (Python or PowerShell preferred; Bash or Perl also valued) Experience with streaming platforms (Kafka, Kinesis, or equivalent) Expert in CI/CD experience using Bamboo/Jenkins and BitBucket/GitLab Configuration management with Ansible (Ansible Tower is highly valued) SQL Server and More ❯

data platform. What You’ll Get A key engineering role within a world-class technology organisation that values innovation and impact. Exposure to a modern data ecosystem including Iceberg, Kafka, Airflow, and other open-source technologies. A collaborative, intellectually curious culture where engineers are trusted to take ownership and drive outcomes. Excellent compensation package with strong performance incentives. What … oriented language. Proficiency in SQL (both transactional and analytical use cases). Experience working with data lakes, ETL frameworks, and orchestration tools such as Airflow. Familiarity with streaming systems (Kafka) and metadata management tools. Solid knowledge of cloud environments (AWS preferred) and Kubernetes. Understanding of DevOps, CI/CD, and infrastructure as code. A proactive, inquisitive approach who enjoys More ❯

data platform. What You’ll Get A key engineering role within a world-class technology organisation that values innovation and impact. Exposure to a modern data ecosystem including Iceberg, Kafka, Airflow, and other open-source technologies. A collaborative, intellectually curious culture where engineers are trusted to take ownership and drive outcomes. Excellent compensation package with strong performance incentives. What … oriented language. Proficiency in SQL (both transactional and analytical use cases). Experience working with data lakes, ETL frameworks, and orchestration tools such as Airflow. Familiarity with streaming systems (Kafka) and metadata management tools. Solid knowledge of cloud environments (AWS preferred) and Kubernetes. Understanding of DevOps, CI/CD, and infrastructure as code. A proactive, inquisitive approach who enjoys More ❯

Senior Java Developer - Java, Kotlin, Concurrency, Kafka, RDBMS, Unix, Linux, Front Office, Multi-threading Role Overview: I am seeking a Senior Java Developer to join a leading Investment Bank as part of their global front-office technology team. This is a hands-on position focused on working with a real-time, event-driven system that underpins our industry-leading … event processing and data management. Key Responsibilities: Develop, implement, and maintain highly performant, secure, and scalable Java applications. Java Server Side Concurrent Programming with Spring Boot (Core Spring) Leverage Kafka or other message queue systems to handle asynchronous processing. Design, optimize, and maintain MongoDB (NoSQL) database schemas. Craft and optimize advanced SQL queries for relational databases. Create comprehensive unit … full ownership of feature development from design through to production deployment. Collaborate effectively with cross-functional teams, balancing independence and teamwork. Key Skills: Java Kotlin Concurrency Message-driven architectures - Kafka, MQ SQL Queries Unix/Linux scripting Multithreading This is a full time role offering a salary of up to £130k. You will be required to attend the office More ❯

Senior Java Developer - Java, Kotlin, Concurrency, Kafka, RDBMS, Unix, Linux, Front Office, Multi-threading Role Overview: I am seeking a Senior Java Developer to join a leading Investment Bank as part of their global front-office technology team. This is a hands-on position focused on working with a real-time, event-driven system that underpins our industry-leading … event processing and data management. Key Responsibilities: Develop, implement, and maintain highly performant, secure, and scalable Java applications. Java Server Side Concurrent Programming with Spring Boot (Core Spring) Leverage Kafka or other message queue systems to handle asynchronous processing. Design, optimize, and maintain MongoDB (NoSQL) database schemas. Craft and optimize advanced SQL queries for relational databases. Create comprehensive unit … full ownership of feature development from design through to production deployment. Collaborate effectively with cross-functional teams, balancing independence and teamwork. Key Skills: Java Kotlin Concurrency Message-driven architectures - Kafka, MQ SQL Queries Unix/Linux scripting Multithreading This is a full time role offering a salary of up to £130k. You will be required to attend the office More ❯

microservice-based Loyalty and Benefits platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum team, you will be building … at least one back-end type safe programming language (Golang Preferred) · Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) · Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that are tested and automated throughout … software engineering methodology (Agile, incl Scrum, Kanban, SAFe, Test-Driven Development (TDD), Behavior Driven Development (BDD) and Waterfall) Knowledge of any or all of the following technologies is desired: Kafka, Postgres, Golang, Git, gRPC, Docker, GraphQL · Experienced in continuous integration (CI), continuous deployment (CD) and continuous testing (CT), including tools such as Jenkins, Rally and/or JIRA and More ❯

microservice-based Loyalty and Benefits platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum team, you will be building … at least one back-end type safe programming language (Golang Preferred) · Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) · Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that are tested and automated throughout … software engineering methodology (Agile, incl Scrum, Kanban, SAFe, Test-Driven Development (TDD), Behavior Driven Development (BDD) and Waterfall) Knowledge of any or all of the following technologies is desired: Kafka, Postgres, Golang, Git, gRPC, Docker, GraphQL · Experienced in continuous integration (CI), continuous deployment (CD) and continuous testing (CT), including tools such as Jenkins, Rally and/or JIRA and More ❯

. Design data architecture including XDM/XDB schemas (AEP), identity graphs, event models, and canonical data models for customer 360. Define integration patterns: API-first approaches, event streaming (Kafka, Pub/Sub), batch ETL/ELT, and data warehouse connectors (Snowflake, BigQuery). Specify security, compliance, and privacy controls (PII handling, encryption, consent propagation). Develop migration strategies … at least two major MarTech products (Adobe AEP/AEM, Braze, SFMC, Tealium, Segment, or mParticle). Deep understanding of cloud platforms (AWS/GCP/Azure), streaming technologies (Kafka, Pub/Sub), and data warehouses (Snowflake, BigQuery). Proficiency in SQL, a scripting language (Python/Node.js), and familiarity with infrastructure-as-code (Terraform/CloudFormation). Strong More ❯

. Design data architecture including XDM/XDB schemas (AEP), identity graphs, event models, and canonical data models for customer 360. Define integration patterns: API-first approaches, event streaming (Kafka, Pub/Sub), batch ETL/ELT, and data warehouse connectors (Snowflake, BigQuery). Specify security, compliance, and privacy controls (PII handling, encryption, consent propagation). Develop migration strategies … at least two major MarTech products (Adobe AEP/AEM, Braze, SFMC, Tealium, Segment, or mParticle). Deep understanding of cloud platforms (AWS/GCP/Azure), streaming technologies (Kafka, Pub/Sub), and data warehouses (Snowflake, BigQuery). Proficiency in SQL, a scripting language (Python/Node.js), and familiarity with infrastructure-as-code (Terraform/CloudFormation). Strong More ❯

high-pressure, performance-driven teams. Roles and Responsibilities: Develop and maintain high-performance, low-latency Java-based systems for front office trading or pricing platforms. Build reactive systems using Kafka Streams , Akka , Eclipse Vert.x , or Apache Flink . Utilize multithreading , concurrency models , and Executor Services to optimize system performance and throughput. Write clean, efficient, and maintainable code using functional … Key Requirements: 6+ years of hands-on Java development experience, preferably in front office systems (e.g., trading platforms, pricing engines, market data systems). Proven expertise in reactive programming (Kafka Streams, Akka, Vert.x, Flink). Solid understanding of multithreading and Executor Services in Java. Strong background in functional programming and Java 8+ features. Adherence to robust engineering practices: SOLID More ❯

high-pressure, performance-driven teams. Roles and Responsibilities: Develop and maintain high-performance, low-latency Java-based systems for front office trading or pricing platforms. Build reactive systems using Kafka Streams , Akka , Eclipse Vert.x , or Apache Flink . Utilize multithreading , concurrency models , and Executor Services to optimize system performance and throughput. Write clean, efficient, and maintainable code using functional … Key Requirements: 6+ years of hands-on Java development experience, preferably in front office systems (e.g., trading platforms, pricing engines, market data systems). Proven expertise in reactive programming (Kafka Streams, Akka, Vert.x, Flink). Solid understanding of multithreading and Executor Services in Java. Strong background in functional programming and Java 8+ features. Adherence to robust engineering practices: SOLID More ❯

Developer will design, develop, and implement data-intensive applications across the full engineering lifecycle. You’ll architect and deliver microservices-based systems using Go (Golang), AWS, Kubernetes, Docker, and Kafka, working closely with cross-functional teams to build scalable, reliable, and resilient platforms. You’ll also play a key role in optimising system performance, improving reliability, and ensuring scalability … including system design and architecture Background in complex, large-scale, data-driven applications Product-focused approach, ideally within fast-paced tech organisations (start-ups or scale-ups) Knowledge of Kafka, Cassandra, gRPC, and microservices is a strong advantage Open-source contributions are beneficial If you’re a Senior Go Developer looking for a challenging 6-month contract with a More ❯

Developer will design, develop, and implement data-intensive applications across the full engineering lifecycle. You’ll architect and deliver microservices-based systems using Go (Golang), AWS, Kubernetes, Docker, and Kafka, working closely with cross-functional teams to build scalable, reliable, and resilient platforms. You’ll also play a key role in optimising system performance, improving reliability, and ensuring scalability … including system design and architecture Background in complex, large-scale, data-driven applications Product-focused approach, ideally within fast-paced tech organisations (start-ups or scale-ups) Knowledge of Kafka, Cassandra, gRPC, and microservices is a strong advantage Open-source contributions are beneficial If you’re a Senior Go Developer looking for a challenging 6-month contract with a More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

building asynchronous, event-driven systems using modern Java technologies. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban/Scrum) 🧠 What You Bring … problems. Strong hands-on experience with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background in Banking/Payments is helpful More ❯

platform teams to make sure the company’s AI models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect and maintain real-time streaming data systems (Kafka, Kinesis, or Flink) Build robust feature pipelines using Airflow, Prefect, or Dagster Manage and optimise data storage solutions (Snowflake, BigQuery, Redshift, or Delta Lake) Automate and scale model training … Terraform, or dbt Champion data reliability, scalability, and performance across the platform 🧩 The Tech Environment You’ll likely be working with some combination of: Languages: Python, Scala, Go Streaming: Kafka/Flink/Spark Structured Streaming Workflow orchestration: Airflow/Prefect/Dagster Data storage & processing: Snowflake/Detabricks/BigQuery/Redshift Infrastructure: Docker/Kubernetes/Terraform More ❯

Technical Data Lead Central London Up to £150,000+ Benefits My client is seeking a Technical Data Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading insurance firm in London. This role requires More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong expertise in … the design, implementation, and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to … will be key in enabling organizations to unlock the value of real-time data, improve operational efficiency, and accelerate digital transformation. Responsibilities Act as the primary technical owner for Kafka and Confluent Cloud implementations. Design, configure, and maintain Kafka clusters, topics, and streaming pipelines. Ensure secure, reliable, and scalable data onboarding from various sources to both on-prem More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong expertise in … the design, implementation, and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to … will be key in enabling organizations to unlock the value of real-time data, improve operational efficiency, and accelerate digital transformation. Responsibilities Act as the primary technical owner for Kafka and Confluent Cloud implementations. Design, configure, and maintain Kafka clusters, topics, and streaming pipelines. Ensure secure, reliable, and scalable data onboarding from various sources to both on-prem More ❯

automated trading systems for UK energy markets Develop real-time bidding, dispatch, and optimization tools Build monitoring dashboards for LAES operations and grid stability systems Develop data pipelines using Kafka and TimescaleDB Create microservices to connect trading platforms and grid operators What We’re Looking For Strong Software Fundamentals: Excellent Python skills (Rust is a bonus) and experience designing … distributed systems, REST APIs, and microservices Data & Infrastructure: Experience with Kafka or similar streaming technologies, PostgreSQL, and time-series data management DevOps & Observability: Familiar with Docker, monitoring, and observability tools Bonus Points For: Prior experience with energy markets, trading systems, industrial control systems, or IoT environments If you’re passionate about applying your software skills to the clean energy More ❯

automated trading systems for UK energy markets Develop real-time bidding, dispatch, and optimization tools Build monitoring dashboards for LAES operations and grid stability systems Develop data pipelines using Kafka and TimescaleDB Create microservices to connect trading platforms and grid operators What We’re Looking For Strong Software Fundamentals: Excellent Python skills (Rust is a bonus) and experience designing … distributed systems, REST APIs, and microservices Data & Infrastructure: Experience with Kafka or similar streaming technologies, PostgreSQL, and time-series data management DevOps & Observability: Familiar with Docker, monitoring, and observability tools Bonus Points For: Prior experience with energy markets, trading systems, industrial control systems, or IoT environments If you’re passionate about applying your software skills to the clean energy More ❯

not just code syntax. What you’ll be doing Designing automated trading systems for green energy markets Building real-time bidding, dispatch, and optimisation tools Developing data pipelines using Kafka & TimescaleDB Creating microservices that connect trading platforms and grid operators Building monitoring dashboards for grid stability and energy storage operations What they’re looking for Strong software fundamentals — ideally … Python , Rust is a bonus Experience with distributed systems, REST APIs, and microservices Knowledge of Kafka (or similar), PostgreSQL , and time-series data Familiar with Docker, monitoring, and observability tools ✅ Experience in a startup or scale-up , collaborating closely with engineers in a fast-moving environment Bonus points if you’ve worked in energy markets, trading systems, industrial control More ❯