51 to 67 of 67 Kafka Jobs in London

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Description: *Redis cluster setup *Kafka/Flink streaming pipelines *S3 Data pipeline *Real time micro batches implementation (5 minutes, hourly, daily) *Mongo/Atlas as alternative implementation (we might land with S3 instead) *SageMakerMLOps/SageMaker Training/SM Model Deployment *Pytorch ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

microservices capable of processing millions of records daily. Working within an enterprise environment, you’ll contribute to the architecture and infrastructure on AWS, leveraging Kafka, while also providing technical leadership and fostering team performance through knowledge sharing and innovation. Responsibilities: Design and deploy cloud infrastructure using Terraform across multiple … practices About You 3-5 years in Cloud Engineering or DevOps roles Strong experience with Terraform for infrastructure provisioning Hands-on experience managing Apache Kafka in production Proficiency with Bosun for monitoring and alerting Solid understanding of cloud platforms (AWS) Experience with CI/CD tools and automation Strong ...

one. ⚙️ What You’ll Be Doing 💡 Designing and developing C#.NET Core microservices and APIs for payments, settlements, and orchestration ⚡ Building event-driven components with Kafka , RabbitMQ , or Azure Service Bus for real-time processing 🔍 Owning system performance, reliability, and scalability — including monitoring, tuning, and fault tolerance 🤝 Collaborating with Product … payment systems 🧩 Driving engineering excellence — CI/CD, testing, observability, and automation across the stack 🧠 Tech Stack 💻 C#.NET Core , REST/gRPC, microservices architecture 📬 Kafka , RabbitMQ , or Azure Service Bus (event-driven systems) ☁️ Azure/AWS , Docker/Kubernetes , IaC, CI/CD ( Azure DevOps , GitHub Actions ) 🗄️ SQL Server ...

month, deliver the best user experiences and personalisation for talent and talent seekers. We built in-house large scale tracking platform, powered by Tealium, Kafka and Adobe Analytics, and successfully rolled it out to 10 of our brands. Along with the tracking we are owners of our AB testing … hypermedia APIs Proficient in Web Technologies like HTML, CSS, JavaScript, React.js, Next.js and Node.js, and in event-driven and eventual consistency systems using Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift ...

infrastructure that handles massive spikes during on-sale events. Our tech stack includes Node.js/.NET microservices, PostgreSQL/MSSQL databases, ElasticSearch, Redis, and Kafka running on AWS EKS (Kubernetes), managed via Terraform with CI/CD pipelines and DataDog monitoring. Your responsibilities include improving infrastructure performance and reliability … similar for monitoring and alerting Desired Skills: Experience with both PostgreSQL and MS SQL Server Advanced SQL query optimization skills Experience deploying and maintaining Kafka for event-driven architectures Experience deploying and maintaining ETL pipelines Deep understanding of Site Reliability Engineering principles and best practices Experience with backend languages ...

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

Data Engineer (AWS Python Kafka) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data … Engineer role. As a Data Engineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions ...

Responsibilities Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry data (metrics, logs, and traces) at scale. Stream OpenShift telemetry through Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing mechanisms for multi-tenant observability while ensuring … pipelines and observability platforms. Document data flows, schemas, dashboards, and operational runbooks . Required Skills & Experience Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect, KSQL, Kafka Streams). Strong experience with OpenShift/Kubernetes telemetry , including OpenTelemetry and Prometheus. ...

partners, and engineering teams.Operating autonomously while ensuring alignment and architectural integrity across teams. What you'll need to succeed Strong hands-on expertise in Kafka/Confluent Kafka, MongoDB, AWS, APIs, and Operational Data Stores (ODS).The ability to contribute with immediate productivity - prior experience delivering streaming ...

design of real-time and batch data platforms for the bank’s strategic data transformation programme. Key Responsibilities Design real-time data architectures using Kafka and AWS streaming services Define end-to-end data architecture patterns (real-time, near-real-time and batch) Create reference architectures, data flow diagrams … banking regulatory requirements (BCBS 239, GDPR, data residency) Essential Skills & Experience 8+ years as a Data Architect or Senior Data Engineer Deep expertise in Kafka (MSK or Confluent) and real-time data architectures Strong AWS data platform experience (S3, Kinesis, Glue, Redshift, Lambda, ECS/EKS) Experience designing both ...

/DevOps team remotely from the UK. They are looking for you to have excellent cloud knowledge, ideally AWS as well as Terraform and Kafka experience. As well as this you will also be expected to have knowledge of GitLab as well as having Python experience is a must. … have an office based in Southwark should you wish to go in. Skills required for the AWS Engineer: * Knowledge of AWS* Working experience of Kafka* Python experience*Excellent communicator This is a really exciting opportunity to rapidly grow your skill set and work closely with some of the most ...

Lead GCP Data Engineer New Malden (Hybrid, approx. 4 days per month onsite) £85,000 to £90,000 plus up to 30 percent bonus This is an opportunity to take ownership of a brand-new ...

governance, index/role mapping, and data quality SLAs. Integrate upstream sources/pipelines: OpenTelemetry (OTLP), Prometheus exporters, Fluentd/Fluent Bit/Vector, Kafka (with TLS), CMDB/ITSM enrichments, and AIOps/ML anomaly detection. Essential Skills & Experience Deep Splunk Enterprise expertise: SPL mastery, CIM alignment … network/storage correlations, capacity/noisy-neighbor detection. Experience with data pipelines/collectors: OpenTelemetry, Prometheus scraping, Fluentd/Fluent Bit/Vector, Kafka (TLS-secured), HEC/UF/DS onboarding. Reliability & SLOs: Golden signals, rollout/rollback health checks, SLO/KPI mapping to namespaces/ ...

resiliency) and node strategy: Queue Processors vs. Job Schedulers, background processing, caching. Integration architecture: REST/JSON, SOAP (if needed), OAuth2/SAML, eventing (Kafka/JMS), idempotency, pagination, circuit breaker and retry patterns. Data design: enterprise data model, data pages (scope, refresh), reference data strategy, data obfuscation … understanding. Integration design mastery: REST with OAuth2 (client credentials, auth code), error handling frameworks, request/response mapping, timeouts, retries, backoff. Event-driven patterns: Kafka/JMS producers/consumers, correlation IDs, exactly-once/at-least-once semantics, dead-letter handling. Performance engineering: PDC triage, PAL reading ...

controls (RBAC, retention, PII handling, TLS, token governance, index and role mapping) Integrate telemetry pipelines including OpenTelemetry, Prometheus, Fluentd/Fluent Bit/Vector, Kafka, CMDB and AIOps/ML solutions Drive SLO/KPI alignment, golden signal monitoring, rollout/rollback health validation, and executive reporting What … events, logs, workload correlation, and capacity management Hands-on experience with telemetry pipelines (OpenTelemetry/OTLP, Prometheus exporters, Fluentd/Fluent Bit/Vector, Kafka with TLS, HEC/UF/DS onboarding) Strong understanding of reliability engineering principles (golden signals, SLO design, namespace/application KPI mapping) Experience ...