126 to 150 of 173 Kafka Jobs in England

Description: *Redis cluster setup *Kafka/Flink streaming pipelines *S3 Data pipeline *Real time micro batches implementation (5 minutes, hourly, daily) *Mongo/Atlas as alternative implementation (we might land with S3 instead) *SageMakerMLOps/SageMaker Training/SM Model Deployment *Pytorch ...

forward-thinking tech company in Leeds, who is looking for a Data Engineer to help develop and scale large telemetry pipelines across OpenShift and Kafka click apply for full job details ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

microservices capable of processing millions of records daily. Working within an enterprise environment, you’ll contribute to the architecture and infrastructure on AWS, leveraging Kafka, while also providing technical leadership and fostering team performance through knowledge sharing and innovation. Responsibilities: Design and deploy cloud infrastructure using Terraform across multiple … practices About You 3-5 years in Cloud Engineering or DevOps roles Strong experience with Terraform for infrastructure provisioning Hands-on experience managing Apache Kafka in production Proficiency with Bosun for monitoring and alerting Solid understanding of cloud platforms (AWS) Experience with CI/CD tools and automation Strong ...

one. ⚙️ What You’ll Be Doing 💡 Designing and developing C#.NET Core microservices and APIs for payments, settlements, and orchestration ⚡ Building event-driven components with Kafka , RabbitMQ , or Azure Service Bus for real-time processing 🔍 Owning system performance, reliability, and scalability — including monitoring, tuning, and fault tolerance 🤝 Collaborating with Product … payment systems 🧩 Driving engineering excellence — CI/CD, testing, observability, and automation across the stack 🧠 Tech Stack 💻 C#.NET Core , REST/gRPC, microservices architecture 📬 Kafka , RabbitMQ , or Azure Service Bus (event-driven systems) ☁️ Azure/AWS , Docker/Kubernetes , IaC, CI/CD ( Azure DevOps , GitHub Actions ) 🗄️ SQL Server ...

join a modern, global Loyalty & Benefits platform powering end-to-end customer experiences at scale. This is a true microservices environment built with Golang, Kafka and Docker, offering the opportunity to shape high-impact features within the Account domain while collaborating across a distributed engineering platform. If you thrive … cloud-native stack Required Experience Strong experience in a Golang preferred Solid understanding of microservice architecture Experience with REST APIs and event-driven systems (Kafka, RabbitMQ or similar) Comfortable working in Scrum/Agile environments Experience delivering through automated CI/CD pipelines Strong communication and collaboration skills Degree ...

underpinning infrastructure Essential skills: • Strong experience in one or both of the following: • Modern software engineering for digital products (Java, microservices, Hexagonal architecture, MongoDB, Kafka) • OR Cloud infrastructure, DevOps, and automation (AWS, Terraform, GitLab CI, Jenkins) • Proven track record of leading engineering teams, providing technical guidance, coaching, and mentoring … disciplinary environments to tight timescales Interested? Please apply below. Lead Java Developer, Technical Lead, Public Sector, Java, Microservices, AWS, Terraform, GitLab CI, Jenkins, MongoDB, Kafka, DevOps, Digital Services, Inside IR35, SC Cleared ...

global Loyalty & Benefits platform powering end-to-end customer experiences at scale. About the Role This is a true microservices environment built with Golang, Kafka and Docker, offering the opportunity to shape high-impact features within the Account domain while collaborating across a distributed engineering platform. If you thrive … modern cloud-native stack Required Skills Strong experience in Golang Solid understanding of microservice architecture Experience with REST APIs and event-driven systems (Kafka, RabbitMQ or similar) Comfortable working in Scrum/Agile environments Experience delivering through automated CI/CD pipelines Strong communication and collaboration skills Strong background ...

month, deliver the best user experiences and personalisation for talent and talent seekers. We built in-house large scale tracking platform, powered by Tealium, Kafka and Adobe Analytics, and successfully rolled it out to 10 of our brands. Along with the tracking we are owners of our AB testing … hypermedia APIs Proficient in Web Technologies like HTML, CSS, JavaScript, React.js, Next.js and Node.js, and in event-driven and eventual consistency systems using Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift ...

solutions. We are looking for a Golang Software Engineer to work within a microservices architecture, building REST APIs and asynchronous messaging services such as Kafka or RabbitMQ. This Golang Software Engineer will operate within a Scrum framework, contributing to business-critical functions delivered through a fully automated CI/… This Golang Software Engineer role is ideal for someone experienced in regulated or fintech environments. Required Skills Golang Microservices architecture REST and asynchronous messaging (Kafka, RabbitMQ) Scrum/Agile delivery CI/CD pipelines and automation Desired Skills Degree in Computer Science, Engineering, or equivalent experience Test-Driven Development ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

teams across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

teams across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

work independently and as part of a team Highly Desirable Experience with Temporal or similar workflow orchestration systems Knowledge of event streaming platforms like Kafka Experience with LLMs and AI integration (particularly for Investigations team) Background in SaaS platforms or B2B products Experience in fintech, compliance, or regulated industries … with observability tools (Grafana, Prometheus, etc.) Understanding of authorisation patterns and security best practices Our Tech Stack Languages: Go Databases: MongoDB Messaging & Orchestration: Temporal, Kafka APIs: REST, gRPC, protobuf Infrastructure: Kubernetes, GCP Observability: Grafana stack AI: LLMs (OpenAI, Gemini), RAG systems What Success Looks Like In your first ...

infrastructure that handles massive spikes during on-sale events. Our tech stack includes Node.js/.NET microservices, PostgreSQL/MSSQL databases, ElasticSearch, Redis, and Kafka running on AWS EKS (Kubernetes), managed via Terraform with CI/CD pipelines and DataDog monitoring. Your responsibilities include improving infrastructure performance and reliability … similar for monitoring and alerting Desired Skills: Experience with both PostgreSQL and MS SQL Server Advanced SQL query optimization skills Experience deploying and maintaining Kafka for event-driven architectures Experience deploying and maintaining ETL pipelines Deep understanding of Site Reliability Engineering principles and best practices Experience with backend languages ...

solutions. We are looking for a Golang Software Engineer to work within a microservices architecture, building REST APIs and asynchronous messaging services such as Kafka or RabbitMQ. This Golang Software Engineer will operate within a Scrum framework, contributing to business-critical functions delivered through a fully automated CI/… This Golang Software Engineer role is ideal for someone experienced in regulated or fintech environments. Required Skills Golang Microservices architecture REST and asynchronous messaging (Kafka, RabbitMQ) Scrum/Agile delivery CI/CD pipelines and automation Desired Skills Degree in Computer Science, Engineering, or equivalent experience Test-Driven Development ...

responsibilities include: End-to-end development of high-performance, distributed data systems built on .NET (currently .NET 8–10). Building and optimising Kafka-based streaming applications and real-time data flows. Designing and implementing ETL components for large-scale market data ingestion. Ensuring platform reliability and minimal downtime … .NET Developer (preferably .NET 8/9/10). Proven experience building high-throughput systems such as: Applications streaming +100GB via Kafka, or Managing +100TB data lakes, or Operating against +10TB relational/time-series/OLAP databases. Strong data streaming experience (Kafka preferred; alternatives such ...

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

Data Engineer (AWS Python Kafka) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data … Engineer role. As a Data Engineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions ...

results for products assigned to them. Key Skills needed: 4 years + Java Development Java 17/21 Spring boot Nexus, Artifactory, Sonar, Jacoco Kafka Nice to have: Kafka Streams, Data sinks OCP RabbitMQ Gatling, JMeter Datadog AWS Spark These roles are based Hybrid in the Hampshire office ...

Responsibilities Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry data (metrics, logs, and traces) at scale. Stream OpenShift telemetry through Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing mechanisms for multi-tenant observability while ensuring … pipelines and observability platforms. Document data flows, schemas, dashboards, and operational runbooks . Required Skills & Experience Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect, KSQL, Kafka Streams). Strong experience with OpenShift/Kubernetes telemetry , including OpenTelemetry and Prometheus. ...

Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs … data pipelines and observability platforms. Document data flows, schemas, dashboards, and operational runbooks. Required Skills: Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect/KSQL/KStream). Proficiency with OpenShift/Kubernetes telemetry (OpenTelemetry, Prometheus) and CLI tooling. Experience ...