1 to 25 of 103 Kafka Jobs in London

experience in IT/financial services. Strong Payments and Ledger domain experience within UK Finance. Deep expertise in Streaming Data Technologies, including: Confluent Kafka Apache Flink Java ODS/MongoDB Proven experience with high-volume, low-latency payment systems. Excellent senior stakeholder management and communication skills. Experience working ...

tools and automation, incident response, observability, performance optimisation and operational excellence, working with large scale Java JVM distribution systems and message brokers such as Kafka and ActiveMQ, with a mix of on-premise and cloud (AWS) based services. Location/WFH: There's a hybrid model with … knowledge of Site Reliability Engineering and how to build scalable solutions to improve reliability, productivity and efficiency You have strong experience with message brokers (Kafka, ActiveMQ or similar) You have experience with containerisation (they use Nomad so that would be great but any tools is fine) You have ...

these or similar tools yet. This position is probably not for you. Backend Engineering experience using either Java, Golang or Rust. Experience working with Kafka/event-driven systems . Package & Benefits Up to 150,000 Base Salary + Bonus Medical & Dental Insurance Pension 4 Weeks ...

Experience with Airflow or other workflow orchestration tools Knowledge of CI/CD pipelines for data platforms Experience with Real Time or streaming data (Kafka, Kinesis) Exposure to data visualization or BI tools AWS certifications (eg, AWS Certified Data Engineer/Solutions Architect ...

financial services environments. Hands-on experience building and managing Apache Airflow/Spark and Hadoop clusters. Deep experience in big data engineering, including Hadoop, Kafka, and Spark-based data pipelines. Strong SQL/RDBMS experience: PostgreSQL, SQL Server. Experience with NoSQL/distributed databases, such as MongoDB. Proven delivery ...

appropriate to the seniority of the role; JAVA programming experience as the core language, including Spring Boot. Fluent in writing JAVA coding. Experience with Kafka or a similar platform. Experience with Scala and Spark. Integrating with backing services, such as PostgreSQL, Redis or S3 Good engineering practices including continuous ...

operating distributed systems at scale Strong cloud background (AWS/Azure), Terraform and Kubernetes Experience with observability tooling (Prometheus, Grafana, EFK) and messaging systems (Kafka) Solid understanding of networking fundamentals and global architecture Comfortable operating at Principal level and influencing technical direction ...

from on-premises/mainframe to cloud platforms (AWS Aurora preferred), ensuring performance, security, and scalability Integration & ETL Pipelines: Build robust pipelines using CDC Kafka/S3 Aurora with UPSERT/MERGE patterns; guarantee idempotency, ordering, and reliable delivery Data Encoding & Validation: Manage EBCDIC UTF-8 conversions, packed decimal … tools (IBM CDC or similar) and data migration strategies Proven experience in PostgreSQL cloud hosting and migration Proficiency in ETL/ELT pipelines, Kafka, and AWS ecosystem Solid understanding of data encoding, transformation, and validation techniques Familiarity with IaC, CI/CD, and observability frameworks Excellent problem-solving ...

containerisation tools such as Docker and Kubernetes - Hands-on experience with cloud platforms like Azure, AWS, and Databricks - Familiarity with messaging protocols (MQ, Kafka), API design, and secure integration patterns - Ability to define observability metrics and guide testing and monitoring efforts - Excellent documentation, communication, and stakeholder engagement skills Nice ...

Senior Software Engineer/Developer (Java AWS Kafka) London/WFH to £140k Are you a Java technologist who enjoys building systems from scratch? You could be progressing your career, in a senior, impactful role at a global, cloud-native, prime broker that is replacing the legacy infrastructure used … with TypeScript/React You take in pride in producing clean, high quality code You're familiar with modern software engineering tools such as Kafka, Kubernetes, MongoDB You are collaborative and pragmatic, able to take ownership and work with others You have experience across the full development lifecycle ...

Java Developer/Software Engineer (Java AWS Kafka) London/WFH to £90k Are you a bright, ambitious Java technologist who enjoys building systems from scratch? You could be progressing your career at a global, prime broker that is replacing the legacy infrastructure used across capital markets with … with TypeScript/React You take in pride in producing clean, high quality code You're familiar with modern software engineering tools such as Kafka, Kubernetes, MongoDB You are collaborative and motivated to learn about financial markets and advance your technical knowledge What ...

preferred), including logical and physical data modelling, referential integrity, and denormalization decisions. Build integration pipelines from Db2 to target pipelines (Aurora Postgress preferred) via Kafka/S3, ensuring idempotency, ordering, and reliable delivery semantics. Your Profile Essential Skills/Knowledge/Experience Change Data Capture: CDC design and operations … catalog, z/OS fundamentals, batch windows, performance considerations. Relational modelling: Data modelling; normalization, indexing, partitioning; OLTP vs. analytics trade-offs. Integration patterns: Kafka (hands-on), CDC-to-target pipelines, UPSERT/MERGE logic; Python/SQL; strong troubleshooting. Data quality mindset: Write validation tests before migration; golden-source ...

experience PostgreSQL expertise Familiarity with Docker & CI/CD (Jenkins, GitHub Actions, etc.) Bonus Points For: Financial services , trading systems background Messaging systems (RabbitMQ, Kafka) AWS or other cloud platforms TypeScript, RxJS, GWT, React Low-latency system design experience What we offer - Competitive salary & bonus - Hybrid working or fully ...

environment with ownership and autonomy Nice to Have Experience with vector databases or embedding pipelines Understanding of event-driven or real-time systems (Kafka, Pub/Sub, etc.) Knowledge of API authentication, access control, or multi-tenant architectures Familiarity with React or other front-end frameworks (for internal tools ...

experience in Support, DevOps, SRE, or related technical roles, ideally within financial technology environments. Strong technical expertise with Python, Unix, PostgreSQL, and familiarity with Kafka, CockroachDB, FastAPI, GraphQL, Snowflake, Redis, and QuestDB or equivalent technologies. Proven experience designing and implementing monitoring and alerting tools (DataDog, Grafana). Solid experience ...

components, or Python for data and ML workflows. Distributed Systems Expertise: Deep experience building high-throughput, fault-tolerant systems using modern messaging standards (e.g., Kafka , ZeroMQ , NATS ). Systems-Level Intuition: You are comfortable debugging and profiling at the OS level, understanding memory management, CPU architecture, and network stack ...

develop others whilst leading projects and remaining hands-on with architecture and development You have experience with AWS You're familiar with Python, Golang, Kafka, Kubernetes You're collaborative and pragmatic with great communication skills Apply now to find out more about this Backend Staff Engineer/Developer (Java ...

one. What You'll Be Doing Designing and developing C#.NET Core microservices and APIs for payments, settlements, and orchestration Building event-driven components with Kafka, RabbitMQ, or Azure Service Bus for real-time processing Owning system performance, reliability, and scalability — including monitoring, tuning, and fault tolerance Collaborating with Product … payment systems Driving engineering excellence — CI/CD, testing, observability, and automation across the stack Tech Stack C#.NET Core, REST/gRPC, microservices architecture Kafka, RabbitMQ, or Azure Service Bus (event-driven systems) Azure/AWS, Docker/Kubernetes, IaC, CI/CD (Azure DevOps, GitHub Actions) SQL Server ...

Python Previously worked at a start up/smaller sized company 5 years+ experience Ability to build software which scales Building messaging queues e.g., Kafka (nice to have) This is entirely a Python back-end development role (Python 3), where the core framework used is FastAPI and Kafka ...

Mongo, Redis, Object) Experience with async and bi-directional communication protocols and patterns (eg. WebSockets, SSE) Designed and implemented event-driven distributed systems (eg. Kafka/Pulsar, RabbitMQ, MQTT, or similar) Experience with container orchestration and service containerisation (Kubernetes, Docker) Built and deployed services on any major cloud providers ...

definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive ...

distributed systems, performance and failure modes, and experience with observability tooling. Comfortable with several languages (e.g. Python, Java, Kotlin, TypeScript) and technologies like Kafka, Flink, Redis and clustered Postgres. Familiarity with networking concepts (routing, load balancing, service‐to‐service communication); bonus points for leading teams and managing Kubernetes‐based ...

with relational (MySQL) and NoSQL databases Strong debugging, troubleshooting, and performance optimisation skills Technical Skills Backend: TypeScript, NestJS, Sequelize, REST APIs, GraphQL, MySQL, NoSQL, Kafka Frontend: React, Next.js, TypeScript, Chakra UI, React Query, GraphQL integration Tools & Design: Ability to work from Figma designs and translate complex requirements into code ...

largest banks across Europe. Design and build scalable, high-availability systems processing millions of real-time transactions Work with Java 17+, Spring WebFlux, AKKA, Kafka, and more Write clean, testable code using TDD and BDD Contribute to architectural decisions in a fast-evolving codebase Collaborate within Agile teams (Kanban … with Java 11+ (ideally Java 17) Solid knowledge of Reactive Programming (e.g., Spring WebFlux, AKKA) Experience with event-driven architecture, real-time messaging systems (Kafka, JMS) Familiarity with asynchronous request handling, scalability, and system resilience Agile mindset, with TDD/BDD and CI/CD experience Bonus: Background ...

Enable dashboards and reporting using Amazon QuickSight (or equivalent BI tools). Streaming & Event-Driven Architecture Design and implement real-time streaming pipelines using: Kafka (Confluent or AWS MSK) AWS Kinesis/Kinesis Firehose EventBridge for AWS-native event routing Define patterns for: Ordering, replay, retention, and idempotency … least-once and exactly-once processing Dead-letter queues (DLQs) and failure recovery Implement CDC pipelines from Aurora PostgreSQL into Kafka and the lakehouse. Event Contracts & Schema Management Define and govern event contracts using Avro or Protobuf . Manage schema evolution through Schema Registry , including: Compatibility rules Versioning strategies ...