201 to 225 of 232 Kafka Jobs in the UK

Manchester (Hybrid) | Digital Transformation Consultancy Location : Manchester (Hybrid - 3 days a week) Package : £60k-£70k + Benefits Python | Cloud (AWS/Azure/GCP) | Kafka | Airflow | PostgreSQL | Observability This client builds mission‐critical digital platforms that make the UK smarter, safer, greener and healthier. They are a growing digital … Doing Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and validation as first‐class concerns across pipelines Deliver monitoring and observability (Prometheus, Grafana or equivalent) and runbook automation ...

with Go and some Python. Skills in testing, SOLID, and design patterns are a must. Systems architecture. Indexing Platform makes extensive use of Kubernetes, Kafka, Redis, and Postgres, and many internal and third-party APIs, with a focus on resilience, monitoring, alerting, and automation. Hard skills: Proficiency in Python … object-oriented programming, and design patterns. Proficiency in testing. Ability to naturally write clear, unconvoluted, testable code. Experience with Kubernetes, Kafka, and Redis (user level). Experience with AWS and/or Google Cloud (user level). Soft skills: Strong team player. Strong communication skills. Bonus points: Experience with ...

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Code across dev & prod Building robust observability and monitoring frameworks Supporting uptime/SLAs Designing and maintaining Kubernetes clusters (advanced configuration) Designing and maintaining Kafka clusters (including DR & scaling strategy) Building and optimising CI/CD pipelines Identifying infrastructure vulnerabilities and improving resilience What We're Looking For 3+ … years DevOps experience in a SaaS environment Strong AWS expertise Advanced Kubernetes administration Advanced Kafka administration (DR, topic scaling, performance tuning) Infrastructure as Code (Terraform essential) Config management (Ansible, Chef or Puppet) CI/CD tooling (Git, Jenkins or GitHub Actions) Distributed systems knowledge Strong networking knowledge (TCP/ ...

Role: Data Architect Location: Remote Rate: £600/Day (Outside IR35) Start: ASAP Clearance: Active SC Essential We are seeking an experienced Data Architect to join our growing data and AI function. This role is ...

partners, and engineering teams.Operating autonomously while ensuring alignment and architectural integrity across teams. What you'll need to succeed Strong hands-on expertise in Kafka/Confluent Kafka, MongoDB, AWS, APIs, and Operational Data Stores (ODS).The ability to contribute with immediate productivity - prior experience delivering streaming ...

Contract Location: London, UK Hybrid Job details: The role involves hands-on responsibilities as well as team coordination aspects. Must have skills: Springboot/Kafka , coding experience 10+ years of experience in Java, Springboot, Kafka and expertise building microservices and event based architecture click apply for full ...

Contract Location: London, UK Hybrid Job details: The role involves hands-on responsibilities as well as team coordination aspects. Must have skills: Springboot/Kafka , coding experience 10+ years of experience in Java, Springboot, Kafka and expertise building microservices and event based architecture. Along with delivery, person needs ...

experience with asynchronous Rust and networked services Solid understanding of distributed systems and event-driven architecture Experience with messaging or streaming platforms such as Kafka Comfortable diagnosing issues across the full technical stack Technical Environment Rust with async frameworks (Tokio, Axum, Actix or similar) Distributed microservices architectures Event-driven … systems and Kafka gRPC and high-throughput APIs Large-scale backend systems supporting significant user or transaction volume Ideal Background Candidates often come from high-scale technology environments such as fintech, trading platforms, payments, or large consumer applications. Engineers with experience building complex distributed systems (in Rust) in other ...

/DevOps team remotely from the UK. They are looking for you to have excellent cloud knowledge, ideally AWS as well as Terraform and Kafka experience. As well as this you will also be expected to have knowledge of GitLab as well as having Python experience is a must. … have an office based in Southwark should you wish to go in. Skills required for the AWS Engineer: * Knowledge of AWS* Working experience of Kafka* Python experience*Excellent communicator This is a really exciting opportunity to rapidly grow your skill set and work closely with some of the most ...

What you’ll work on Designing and improving high-volume data pipelines Optimising performance across ClickHouse and Postgres Working with streaming/event systems (Kafka-style architectures) Improving reliability and observability of data workflows Debugging real production data and performance issues Supporting data platform evolution and migration initiatives Contributing … fundamentals Experience operating data systems at scale Experience with at least two of: Columnar databases (ClickHouse, BigQuery, etc.) Relational databases (Postgres, MySQL) Streaming systems (Kafka, Kinesis, etc.) Strong performance debugging skills Experience in one or more of: TypeScript/Node, Go, Python Ability to reason about behaviour under load ...

scraper consolidation, and platform resilience improvements. Rationalise, deduplicate, and govern curves across systems. Architect and oversee a Medallion-style platform using Python, React, ClickHouse, Kafka/event streaming, Azure/AWS, and C#/.NET. Remain hands-on with design, prototyping, code reviews, and architecture decisions. Lead engineers, data … high-data environments. Hands-on Python experience and familiarity with modern frameworks; React for UI delivery. Experience with streaming/event-driven architectures (Kafka) and large-scale data processing; ClickHouse or similar highly desirable. C#/.NET experience beneficial for legacy systems. Knowledge of energy trading, commodities, or financial ...

token management. Establish data quality SLAs and index/role mapping practices. Integrations & Pipelines Integrate OpenTelemetry, Prometheus exporters, Fluentd/Fluent Bit/Vector, Kafka, CMDB/ITSM, and AIOps/ML-based anomaly detection. Required Skills Splunk Enterprise Strong SPL expertise, CIM alignment, lookups/macros, saved searches. … capacity planning, node/network/storage troubleshooting. Data Pipelines & Collectors Experience with OTLP/OpenTelemetry, Prometheus scraping. Fluentd/Fluent Bit/Vector, Kafka (TLS), HEC/UF/DS onboarding. Reliability & SLO Engineering Familiarity with golden signals, rollout/rollback health checks, SLO/KPI mapping. Ability ...

Data Engineer (Pharma Background Essential) £550 per day - INSIDE IR35 6 Months Hybrid - 1 day per week in London Role Purpose We are currently looking for a Data Engineer to be responsible for designing, building ...

Lead GCP Data Engineer New Malden (Hybrid, approx. 4 days per month onsite) £85,000 to £90,000 plus up to 30 percent bonus This is an opportunity to take ownership of a brand-new ...

container-related issues in production environments Implement and maintain monitoring, alerting, and logging solutions Support operational aspects of platforms such as: MongoDB, PostgreSQL, Apache Kafka, OpenSearch Required Skills & Experience Experience working in a DevOps or Platform Engineering role Strong knowledge of Linux and working knowledge of Windows Hands … PowerShell Familiarity with monitoring, alerting, and incident management practices Desirable Skills: Experience with GitOps tooling (Argo CD) Experience with Bamboo and Bitbucket Knowledge of Kafka, MongoDB, or PostgreSQL operations Experience operating OpenSearch or similar logging platforms Understanding of cloud security and access control (RBAC, secrets ...

Streaming APIs, Reltio Connect/Hub, real-time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms Collaborate on data pipelines (e.g., via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present … consent/campaign preference management, multi-brand hierarchies) Exposure to cloud-native data platforms (AWS/Azure/GCP) and data integration tools (e.g., Kafka, Informatica IICS, Talend, MuleSoft, Boomi) Knowledge of Mastering for B2B/B2C, Location mastering, Reference data management, and Hierarchy management Understanding of privacy/ ...

Streaming APIs, Reltio Connect/Hub, Real Time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms. Collaborate on data pipelines (eg, via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring . Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs …/campaign preference management, multi-brand hierarchies). Exposure to cloud-native data platforms (AWS/Azure/GCP) and data integration tools (eg, Kafka, Informatica IICS, Talend, MuleSoft, Boomi). Knowledge of Mastering for B2B/B2C , Location mastering , Reference data management , and Hierarchy management . Understanding ...

Senior Engineer – Data Platform Team | C#/.NET, Kafka, Event Driven/Streaming | Up to £95,000 + Bonus + Benefits | Hybrid | FX Trading Firm | London I’m currently working with a London-based trading technology team that’s looking to bring in a Senior Engineer within their Data … problems at scale , rather than just building standard application features. 💻 Tech Stack Key technologies include: • C#/.NET (currently .NET 8/.NET 10) • Kafka or similar event-streaming technologies (RabbitMQ, Kinesis, Azure Service Bus etc.) • PostgreSQL and large relational data systems • Real-time data pipelines and distributed systems ...

Python Previously worked at a start up/smaller sized company 5 years+ experience Ability to build software which scales Building messaging queues e.g., Kafka (nice to have) This is entirely a Python back-end development role (Python 3), where the core framework used is FastAPI and Kafka ...

Solution Architect – Shape the Future of a High-Scale Platform Kafka, SQL, C#, .NET, Golang, TypeScript Are you ready to define and drive the architecture of a platform built to handle millions of transactions per second, powering international growth and long-term scalability? We’re embarking on a full … Define solution architecture and technical strategy for a complex, high-scale platform Own end-to-end design across distributed, event-driven systems (Kafka, SQL, cloud-native) Partner with product, engineering, and business stakeholders to translate vision into architecture Lead technical planning, standards, and best practices across multiple teams Provide ...

Implement automated metadata ingestion from: Data lakes ETL tools (Glue, Informatica, Talend, IICS) Warehouses (Redshift, Snowflake, BigQuery) BI tools (Power BI, Tableau) Streaming sources (Kafka) Build lineage diagrams across ETL pipelines, APIs, datasets, and downstream consumption layers. Ensure metadata completeness, accuracy, and operational SLAs. Your Profile Essential skills/… knowledge/experience: Data lakes ETL tools (Glue, Informatica, Talend, IICS) Warehouses (Redshift, Snowflake, BigQuery) BI tools (Power BI, Tableau) Streaming sources (Kafka) Build lineage diagrams across ETL pipelines, APIs, datasets, and downstream consumption layers. Ensure metadata completeness, accuracy, and operational SLAs. ...