76 to 100 of 110 Kafka Jobs in London

scaling of the platform globally. The right engineer should bring experience with Neo4j, production grade LLM/AI capabilities (RAG, embeddings, inference pipelines), Kafka, Java/JVM and API-first architecture. The position offers a rare modernisation opportunity, you'd be transitioning from a third-party engineering team ...

Interest in financial data (experience helpful but not required) Nice to have: DuckDB experience Time-series experience (market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation ...

multithreading and performance optimisation • Experience working with large scale distributed systems and high volume market or trade data • Familiarity with messaging technologies such as Kafka, AMPS or QPID • Python or bash for tooling and automation, with exposure to Q or KDB considered valuable If you enjoy solving challenging engineering ...

cluster metrics, logs, and event correlation 4.Experience with modern data pipelines and telemetry tools such as OpenTelemetry, Prometheus, Fluentd/Fluent Bit, Vector, and Kafka Desirable Skills/Experience 1.Candidates should be comfortable working in large-scale enterprise environments with complex infrastructure 2.The position requires onsite presence in London ...

optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services Palantir Foundry Stakeholder Engagement Why Apply? Work on mission-critical ...

data between robots and operators Skills we look for Proficiency in building entire systems from scratch, (we’ve built our own video streaming protocol, Kafka-like streaming library and renderers) Experience programming in low-level systems languages, namely Rust. Experience with low latency video streaming in a production environment. ...

continuous deployment (CI/CD) processes. Work with Kubernetes and OpenShift for container orchestration and management. Develop and maintain event streaming solutions using Kafka and Azure Event Hub. Ideal Candidate Profile Java Development : Previous experience as a Java developer, with expertise in Java Quarkus or Java Spring Boot (Java … version 21). Cloud Native : Experience developing in a cloud environment (MS Azure or AWS). Event Streaming : Experience with event streaming infrastructure (e.g., Kafka, Azure Event Hub). DevOps : Experience with DevOps infrastructure and components, including Jenkins, ArgoCD, and Helm charts. Containerization : Proficiency in containerization and orchestration tools ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Principal will own the end-to-end product and platform strategy for an observability and telemetry ecosystem, covering OTEL collectors, OTEL/OPAM agents, Kafka-based data pipelines, and time-series data platforms click apply for full job details ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Hedge Fund - Python Developer (Equities) - Trade life cycle - PnL - Kafka - Contract Our Hedge Fund client is looking for a Python Developer/Engineer Contract role This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role … trade events. Build and operate Python-based services that perform large-scale data transformations and calculations. Publish and distribute transaction and PnL data using Kafka, including AVRO-based schemas and streaming patterns. Required Skills Minimum of 6+ years of professional Python development experience, ideally in capital markets ...

month, deliver the best user experiences and personalisation for talent and talent seekers. We built in-house large scale tracking platform, powered by Tealium, Kafka and Adobe Analytics, and successfully rolled it out to 10 of our brands. Along with the tracking we are owners of our AB testing … hypermedia APIs Proficient in Web Technologies like HTML, CSS, JavaScript, React.js, Next.js and Node.js, and in event-driven and eventual consistency systems using Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

teams across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

work independently and as part of a team Highly Desirable Experience with Temporal or similar workflow orchestration systems Knowledge of event streaming platforms like Kafka Experience with LLMs and AI integration (particularly for Investigations team) Background in SaaS platforms or B2B products Experience in fintech, compliance, or regulated industries … with observability tools (Grafana, Prometheus, etc.) Understanding of authorisation patterns and security best practices Our Tech Stack Languages: Go Databases: MongoDB Messaging & Orchestration: Temporal, Kafka APIs: REST, gRPC, protobuf Infrastructure: Kubernetes, GCP Observability: Grafana stack AI: LLMs (OpenAI, Gemini), RAG systems What Success Looks Like In your first ...

tools and automation, incident response, observability, performance optimisation and operational excellence, working with large scale Java JVM distribution systems and message brokers such as Kafka and ActiveMQ, with a mix of on-premise and cloud (AWS) based services. Location/WFH: There's a hybrid model with … knowledge of Site Reliability Engineering and how to build scalable solutions to improve reliability, productivity and efficiency You have strong experience with message brokers (Kafka, ActiveMQ or similar) You have experience with containerisation (they use Nomad so that would be great but any tools is fine) You have ...

infrastructure that handles massive spikes during on-sale events. Our tech stack includes Node.js/.NET microservices, PostgreSQL/MSSQL databases, ElasticSearch, Redis, and Kafka running on AWS EKS (Kubernetes), managed via Terraform with CI/CD pipelines and DataDog monitoring. Your responsibilities include improving infrastructure performance and reliability … similar for monitoring and alerting Desired Skills: Experience with both PostgreSQL and MS SQL Server Advanced SQL query optimization skills Experience deploying and maintaining Kafka for event-driven architectures Experience deploying and maintaining ETL pipelines Deep understanding of Site Reliability Engineering principles and best practices Experience with backend languages ...

responsibilities include: End-to-end development of high-performance, distributed data systems built on .NET (currently .NET 8–10). Building and optimising Kafka-based streaming applications and real-time data flows. Designing and implementing ETL components for large-scale market data ingestion. Ensuring platform reliability and minimal downtime … .NET Developer (preferably .NET 8/9/10). Proven experience building high-throughput systems such as: Applications streaming +100GB via Kafka, or Managing +100TB data lakes, or Operating against +10TB relational/time-series/OLAP databases. Strong data streaming experience (Kafka preferred; alternatives such ...

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

platform. Expect a low-ego culture where technical autonomy and rapid delivery go hand in hand. Core Day-to-Day Stack: Backend: Java 21, Kafka, Postgres, Docker, Terraform Frontend: SolidJS, TypeScript Infra: AWS (Serverless & Containers), Confluent AI Ops: Heavy daily use of an AI Coding Assistant (we use Claude … ownership matter. Strongly Preferred (The Fast-Track) Domain experience in sports tech, live event data, or video streaming technology (HLS, etc.). Experience in Kafka/Flink/Spark streams. Strong background in data architecture and systems design. What We Offer Competitive Package: £65,000 base salary with ...

Role: Data Architect Location: Remote Rate: £600/Day (Outside IR35) Start: ASAP Clearance: Active SC Essential We are seeking an experienced Data Architect to join our growing data and AI function. This role is ...

partners, and engineering teams.Operating autonomously while ensuring alignment and architectural integrity across teams. What you'll need to succeed Strong hands-on expertise in Kafka/Confluent Kafka, MongoDB, AWS, APIs, and Operational Data Stores (ODS).The ability to contribute with immediate productivity - prior experience delivering streaming ...

Contract Location: London, UK Hybrid Job details: The role involves hands-on responsibilities as well as team coordination aspects. Must have skills: Springboot/Kafka , coding experience 10+ years of experience in Java, Springboot, Kafka and expertise building microservices and event based architecture click apply for full ...

Contract Location: London, UK Hybrid Job details: The role involves hands-on responsibilities as well as team coordination aspects. Must have skills: Springboot/Kafka , coding experience 10+ years of experience in Java, Springboot, Kafka and expertise building microservices and event based architecture. Along with delivery, person needs ...

design of real-time and batch data platforms for the bank’s strategic data transformation programme. Key Responsibilities Design real-time data architectures using Kafka and AWS streaming services Define end-to-end data architecture patterns (real-time, near-real-time and batch) Create reference architectures, data flow diagrams … banking regulatory requirements (BCBS 239, GDPR, data residency) Essential Skills & Experience 8+ years as a Data Architect or Senior Data Engineer Deep expertise in Kafka (MSK or Confluent) and real-time data architectures Strong AWS data platform experience (S3, Kinesis, Glue, Redshift, Lambda, ECS/EKS) Experience designing both ...