1,351 to 1,375 of 1,470 Kafka Jobs in the UK

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

Responsibilities Scale Prometheus metrics infrastructure to handle 100+ million active series . Operate large Elasticsearch clusters holding 2000+TB of data . Grow high-throughput Kafka data pipelines processing hundreds of thousands of events per second. Build custom alerting workflows and self-service APIs for internal engineering teams. Provision cloud … bare-metal machines. 2+ years developing in Go, Python, Ruby, Scala, or Bash. Hands-on experience with Prometheus/Thanos/Cortex, Kafka, the ELK stack, Ansible, or Consul . Comfortable diving into unfamiliar codebases and participating in an on-call rotation. Keywords: Observability, Monitoring, SRE, Site Reliability Engineering ...

additional external data sources means that we'll be able to power businesses across the automotive industry.Spring Boot, Apache Solr, Cloud SQL and Apache Kafka power our platform and process millions of events per day. As a team, our software developers are responsible for ensuring service availability and responsiveness … coaching and sharing technical expertiseAlthough not a requirement, helpful experience includes:Google CloudSQL/Relational databasesDocument/Map based storage (eg: MongoDB)Working with Kafka messaging/streamingDuring our application process, you will be asked two questions to help us learn more about you and how you align with ...

scalable and robust data solutions within a modern cloud-based environment. This is an excellent opportunity to work with cutting-edge technologies including AWS, Kafka, Kubernetes, Java, and Big Data platforms , helping organisations unlock the value of their data. The Role As a Data Engineer, you'll be responsible … commercial experience in Data Engineering . Expert-level proficiency in Java . Advanced experience with Amazon Web Services (AWS) . Advanced experience with Apache Kafka . Advanced experience with Kubernetes . Experience working with Big Data technologies and engineering practices. Proven experience building and maintaining enterprise-scale data pipelines. ...

scalable and robust data solutions within a modern cloud-based environment. This is an excellent opportunity to work with cutting-edge technologies including AWS, Kafka, Kubernetes, Java, and Big Data platforms , helping organisations unlock the value of their data. The Role As a Data Engineer, you'll be responsible … commercial experience in Data Engineering . Expert-level proficiency in Java . Advanced experience with Amazon Web Services (AWS) . Advanced experience with Apache Kafka . Advanced experience with Kubernetes . Experience working with Big Data technologies and engineering practices. Proven experience building and maintaining enterprise-scale data pipelines. ...

external data sources means that we'll be able to power businesses across the automotive industry. Spring Boot, Apache Solr, Cloud SQL and Apache Kafka power our platform and process millions of events per day. As a team, our software developers are responsible for ensuring service availability and responsiveness … technical expertise Although not a requirement, helpful experience includes: Google Cloud SQL/Relational databases Document/Map based storage (eg: MongoDB) Working with Kafka messaging/streaming During our application process, you will be asked two questions to help us learn more about you and how you align ...

systems with industry standard frameworks and tools, such as React and Angular on the front end and Java, Spring Boot, Cloud SQL and Apache Kafka on the back end. All of this runs on our cutting edge cloud delivery platform, facilitating over 60k releases to production a year. Were … RESTful APIs and web services. Strong knowledge of relational databases (SQL), along with experience working with document-based storage solutions (e.g., MongoDB) Experience with Kafka or other event-driven architectures A structured approach to development and testing (including Test-Driven Development) with a focus on continuous delivery and automation ...

systems with industry standard frameworks and tools, such as React and Angular on the front end and Java, Spring Boot, Cloud SQL and Apache Kafka on the back end. All of this runs on our cutting edge cloud delivery platform, facilitating over 60k releases to production a year. … scalable, maintainable, and performant Strong knowledge of relational databases (SQL), along with experience working with document-based storage solutions (e.g., MongoDB) Experience with Kafka or other event-driven architectures A structured approach to development and testing (including Test-Driven Development) with a focus on continuous delivery and automation Proven ...

Kraken's real-time streaming infrastructureOwn the architecture and roadmap for high-volume low-frequency data systems, with focus on data stack like Spark, Kafka, Iceberg, RisingWave, Apache FlinkDesign and operate scalable data architecture that serve trading, risk, compliance, analytics and many product teams.Drive adoption of AI automation … Parquet, Presto), including data modeling, data quality best practices, and self-service tooling.Strong expertise in building and operating real-time data at scale including Kafka, Spark Streaming, Debezium, and CDC pipelines.Proven ability to manage competing priorities across multiple stakeholder groups — aligning platform investments with the needs of product, finance ...

What you’ll do Own the technical architecture of IG’s GCP data platform end-to-end — Core Lake (BigQuery), batch and real-time (Kafka) ingestion, transformation in the Medallion architecture, and Data-Engineering-owned integration services — setting the reference designs and patterns squads build against. Lead delivery … role Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures Demonstrated experience leading or technically mentoring a team of data engineers, with the ability to set standards, conduct code ...

experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand how to design scalable end-to-end architectures … pipelines on large volumes of data (think Kafka/Flink for streaming + AWS Lambda + Kinesis)Solid data engineering fundamentals: pipeline design, SQL, Python, schema modeling, data qualityExperience building or integrating with CDP, marketing automation, or behavioral data-management platformsProven ability to go from ambiguous problem to working ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

Skills: Golang, Microservices, Agile, Kafka, Docker, REST Web Services, CI/CD Work Mode: Full Time Job Status: Open Follow Us On: We are looking for Golang Developer to join our team, who will work closely with development team to develop new system capabilities as defined within the technical … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server. Working knowledge of AWS data services, especially S3. Understanding … data pipelines from legacy mainframe DB2 and on‐prem SQL Server systems into an AWS‐based data lake. Implement real‐time ingestion using Confluent Kafka and land data in Amazon S3. Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold). Design ...

Billing within an event-driven architecture.Key ResponsibilitiesOwn end-to-end solution architecture and HLD across all workstreamsDefine and govern event-driven architecture patterns (Kafka/event streaming, async processing)Manage cross-domain dependencies and ensure integration consistencyProvide architecture governance, design approvals, and CAB stakeholder engagementPartner with Integration Architect, Data … multiple domains: Payments, KYC, Billing, Treasury, OperationsExperience working in onshore leadership roles with offshore delivery teamsTechnical & Domain SkillsStrong experience in event-driven architecture (Kafka, event bus, streaming platforms)Expertise in microservices, APIs, cloud-native architecture (Azure/AWS)Understanding of payment ecosystems (SEPA, SWIFT, Faster Payments, ISO 20022)Familiarity ...

logistics systems). Work with Fogsphere’s API‐driven platform for automation, reporting, and integrations. Configure workflows for publish/subscribe messaging (MQTT, Kafka, or similar). IoT & Sensors Integrate with IoT infrastructure for command and event‐based automation. Configure LoRaWAN networks and sensors (preferred). Customer & Partner Enablement … third‐party system APIs in enterprise environments. Solid understanding of computer vision AI parameters and workflow optimization. Knowledge of publish/subscribe architectures (MQTT, Kafka). Excellent verbal and written communication skills in English. Empathy and patience when supporting and training partners/customers. Preferred Experience Working knowledge ...

evolve backend‐heavy platform capabilities for content and media, including APIs, services, automation pipelines, and developer tooling.Lead the design of event‐driven architectures (Kafka/Confluent or equivalent) to support scalable, resilient content and asset workflows.Own and evolve our federated GraphQL architecture, including schemas, orchestration, versioning, and standards.Contribute hands … designing and running distributed systems in production.Strong experience on the Azure cloud platform, building and operating scalable, reliable services.Solid understanding of event‐driven architectures (Kafka/Confluent experience is a strong plus).Hands‐on experience with GraphQL — schema design, federation, evolution, and API governance (must have).Experience with headless ...

evolve backend‐heavy platform capabilities for content and media, including APIs, services, automation pipelines, and developer tooling.Lead the design of event‐driven architectures (Kafka/Confluent or equivalent) to support scalable, resilient content and asset workflows.Own and evolve our federated GraphQL architecture, including schemas, orchestration, versioning, and standards.Contribute hands … designing and running distributed systems in production.Strong experience on the Azure cloud platform, building and operating scalable, reliable services.Solid understanding of event‐driven architectures (Kafka/Confluent experience is a strong plus).Hands‐on experience with GraphQL — schema design, federation, evolution, and API governance (must have).Experience with headless ...

systems. What you will be doing: Own the design, implementation, and operation of shared Resource Plane services used across the organization Operate and evolve Kafka, RabbitMQ, Redis, and Elasticsearch platforms in production Apply SRE principles to ensure availability, scalability, reliability, and safe upgrades of stateful systems Build and maintain … degree in Computer Science, Software Engineering, or Information Technology Senior-level experience operating production-grade, stateful distributed systems Strong hands-on experience with Kafka, RabbitMQ, Redis, and Elasticsearch Proven experience running infrastructure primarily in on-prem environments Strong understanding of Linux systems, networking, and storage fundamentals Deep experience with ...

diligence. Technical security & architecture: Define and enforce the security architecture across our Azure-native, Kubernetes-based platform. Govern security controls across the full stack: Kafka, .NET/C#, Vue.js, Kong API Gateway, Auth0, and Salesforce. Lead threat modelling, penetration testing, and vulnerability management programmes. Own identity and access management … software engineering — understanding of SDLC security, threat modelling, and DevSecOps. Experience managing a security team and developing talent toward senior positions. Familiarity with Kafka-backed event architectures and the security considerations they introduce. Awareness of AI and machine-learning security risks and emerging AI governance frameworks (e.g. NIST ...

directly affects care delivery at scale. We are rebuilding the technology platform to be event-based, multi-tenant, and agent-ready using .NET on Kafka and Postgres for the new estate. The legacy platform remains active while domains migrate. Our small, senior team works closely with the business. … systems into the right boundaries, reducing complexity and increasing maintainability and business collaboration. Event sourcing, CQRS, and event streaming in production. Akka.NET, EventStore, Marten, Kafka, or similar. You understand event-sourced systems beyond the marketing, where you apply and where you don’t. Postgres at scale. Schema design, performance ...

elevate our current data pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg).Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork … Python & Big Data Expertise: Advanced proficiency in Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg).dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration.Data Architecture Mastery ...

problems and the chance to shape an important company while its foundations are still forming. What You’ll Work On Event-driven architecture and Kafka-based workflows , including long-running processes that behave correctly under retries, replay and partial failure Core data models spanning clients, households, firms, assets, products … TypeScript , or comparable depth in another language and the appetite to work in both Distributed and event-driven systems. Strong understanding of Kafka or an equivalent, including ordering, replay, idempotency and partial failure Data modelling judgement. Experience modelling complex or data-critical systems across SQL and NoSQL, with ...

environment designed for both product delivery and AI integration: TypeScriptNode.js for backend and banking applicationsReact on the frontendPostgreSQL for data storage; Redis, SQS, and Kafka for jobs, queues, and event streamingTerraform to define infrastructure as codeKubernetes, Lambdas, and Step Functions to run our applicationsAWS as our cloud provider, including … reliability. Practical experience, or strong interest, in integrating predictive models, LLM APIs, or other AI capabilities into product backends. Familiarity with technologies such as Kafka, SQS, Step Functions, PostgreSQL, and modern observability practices. Leadership & collaborationYou are: Highly autonomous and comfortable owning backend systems from design to production. Product-minded ...