76 to 100 of 101 Kafka Jobs in London

BODS, SAP CPI/BTP, 3rd party sources and apis, with good understanding of event and message-based integrations using Active MQ/Kafka/AWS kinesis etc, as well as batch processes of synchronous integration involving change pointers and delta refresh · Designing reporting solutions with visualisation suite covering ...

What they're looking for Strong Python + data engineering fundamentals Experience building scalable data pipelines/platforms Exposure to distributed systems (Kafka, Spark, Airflow etc.) Interest in AI/ML systems is a plus ...

including AQR/ECB reporting * Developing data models, data marts and transformations * Working with Azure, Databricks and cloud storage solutions * Supporting middleware integration, including Kafka, IIB or Message Queue * Ensuring strong data quality, governance and compliance standards Robert Walters Operations Limited is an employment business and employment agency ...

must Programming/scripting knowledge Basic SQL CloverDX or other ETL system experience is preferred Knowledge of data transfer protocols preferred (e.g., FIX, sFTP, Kafka, MQ) Ability to think strategically and fully understand a problem before identifying a solution Meticulous attention to detail Ability to manage multiple projects ...

exposed to LLM-based agents. Experience with search relevance & recommendation systems — ranking algorithms, semantic search, personalisation. Hands-on with Snowflake, Databricks, Airflow, Kafka . Why Join Us Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC Shape the future ...

maintain Java based microservices, applying test driven development and following established engineering standards. You'll work with technologies including Java, Spring Boot, Postgres, Kafka, Docker, React and AWS. You'll contribute to CI/CD pipelines, ensure non-functional requirements are met and collaborate with colleagues across engineering, analysis … driven development (JUnit, Mockito or similar) Docker and containerisation CI/CD pipelines (Jenkins or similar) Working in agile, multi-disciplinary teams Desirable experience Kafka Liquibase or similar migration tooling Swagger/OpenAPI Gradle React TypeScript Reasonable Adjustments: Respect and equality are core values to us. We are proud ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Experience with graph xkybehq modelling and large-scale ETL pipelines Strong API design for data-heavy systems Nice to have: UK property data (UPRN), Kafka/event streaming, spatial data experience Details Remote: Europe time zones preferred Type: Full-time (strong contractors considered) Start: Urgent ...

Role: Senior Azure DevOps Engineer (Kafka) Location: Remote (UK) Salary: £75k + 10% Bonus Key Skills: Azure Terraform Kubernetes Kafka Data platforms Overview We're partnering with a fast-growing SaaS organisation building a modern, data-driven platform that powers better insight into behaviour, performance, and collaboration … Code using Terraform Build and maintain CI/CD pipelines using GitHub Actions (essential) Support GitHub-based release and deployment workflows Work with Kafka for event-driven streaming and real-time data movement Support and evolve data platforms (Databricks ideal) Build and maintain data pipelines (batch + streaming/ ...

Software Engineer/Developer (Java Kafka API) London/WFH to £90k Are you a Java technologist seeking a role where you can work on ground breaking technology, continually learning and progressing your career? You could be joining a global technology consultancy. What's in it for you: Salary … will design, develop and deliver a range of transformational projects for clients, mainly within the financial services sector and with a focus on Kafka messaging, migrating legacy systems to AWS and introducing CI/CD pipelines and cloud deployments. You'll join a collaborative team with a focus ...

across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, MongoDB, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, MongoDB, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

time series* Proficiency in SQL and NoSQL databases* Significant experience with Azure Functions, Web Apps, distributed/event-driven architecture (event hub, event bus, Kafka), ELK* Intermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQL* Integration … experience with Confluent/Kafka, API Management, Logic Apps* Practical agile experience in both start-up and enterprise environments* Lead the engineering community to follow Shell Engineer Management standards, ensuring consistency and reuse* Understand and deliver core engineering GPA objectives* Create a collaborative environment for technical roles to drive ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

team, aiding their growth and acting as a force multiplier through your technical leadership. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient in regulated environments. Implement robust data quality controls including testing, validation, monitoring, and alerting. … technical specifications. Ability to work autonomously with a high degree of accountability for the systems you build and maintain. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

EMEA and globally Key skills & experience: Proven experience in Integration/Solution Architecture within financial services or large enterprises Strong knowledge of API gateways, Kafka/MQ, ESB/iPaaS platforms Experience with REST APIs, event-driven systems and distributed architectures Understanding of data platforms, real-time vs batch ...

Designing and delivering scalable APIs and microservices Building backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Handling event-driven architectures (Kafka, SNS/SQS, etc.) Driving system design decisions across distributed systems Improving observability, reliability, and performance in production Debugging complex issues and leading resolution across … teams Staying hands-on while setting technical direction and standards Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) CI/CD (Concourse, Git workflows) Databases (Postgres, DynamoDB, Couchbase) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience ...

Snowflake warehouse. Manage and mentor a team of Data Engineers in a player/coach capacity. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Evolve a configuration-driven platform enabling non-engineers to define regulatory logic. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient … tools. Ability to translate complex regulatory requirements into technical specifications. High ownership mindset and accountability for delivery and reliability. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems stable at scale Collaborating within an existing team … + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience (Python preferred) Experience building and supporting ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there isample opportunityto drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer onanScrum team, you will … other experience can be considered) . Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

problems a plus Automated test experience, Unit testing and Integration testing An understanding of message-driven programming and messaging systems Experience with FIX and Kafka a huge plus To excel in this role, you will need a minimum of 7 years' experience in JVM, with proficiency in both Kotlin … including unit testing and integration testing, is also required. An understanding of message-driven programming and messaging systems, along with experience in FIX and Kafka, would be highly advantageous. If you are ready to take the next step in your career and make a significant impact in the world ...

overall technical direction. Key Responsibilities Design, build, and own backend services and data pipelines in Python Develop and operate streaming systems using Kafka or similar technologies Work with graph-based data structures and algorithms to support analytics and decision-making Build reliable, scalable systems that process real-time data … contribute to code reviews Requirements 5+ years of experience building and operating backend systems in production Strong proficiency in Python Experience with streaming systems (Kafka, Pulsar, or similar) Familiarity with graph data structures and algorithms Experience working with databases (MongoDB or similar) Solid understanding of distributed systems concepts ...

Regulatory explainability Audit trails Reporting obligations across UK, EU, and US Real-Time Risk & Event-Driven Decisioning Define integration patterns for: Real-time scoring Kafka/streaming frameworks Orchestration and fallback strategies Ensure deterministic and observable decision pipelines Architect integrations with external risk/compliance vendors such as: LexisNexis … roles Deep experience in risk and compliance systems within fintech or payments Sanctions & PEP screening expertise Strong hands-on knowledge of: Event-driven architectures Kafka/streaming systems Experience designing structured and event-based data models Cloud-native architecture experience (AWS or Azure; multi-region preferred) Strong background ...

pipelines using GitHub Actions and Jenkins. You will also reduce manual effort through smart automation 🤖, support and improve data and caching systems like Redis, Kafka, MongoDB, Cassandra, enhance observability using Datadog, Grafana, Prometheus, and CloudWatch 📊, and take part in incident response while continuously improving platform reliability 🔥 🧠 What you will … edge platforms such as Fastly or Akamai, and strong scripting skills including Bash plus another language 💻. Experience with messaging or database platforms like Kafka, Redis, MongoDB, or Cassandra is important, alongside a deep understanding of scalable and resilient system design. You should also have sharp troubleshooting skills across ...

during this busy period and be able to add value to their Python team. The Python Developer will need to have worked with Python, Kafka, Open APIs. They need a solid engineer who will hit the ground running and be able to get on with the tasks in hand. … Experience Needed Highly experienced Python Engineer/Developer Can hit the ground running and make an impact from early Technology needed: Python, Kafka, Flask, OpenAPI + FastAPI Excellent communication and collaborative skills needed Python Developer Day Rate: £400 Outside IR35 Duration: 6-months Start Date: ASAP (No long notice ...