21 of 21 Kafka Jobs in Yorkshire

Experience Previous experience of working on GOV/NHS projects or in a consultancy environment. Experience with event‐driven architectures and messaging systems (e.g., Kafka, RabbitMQ). What makes us great Alongside working with some of the most talented people out there and on‐top of a competitive salary ...

stack runs on AWS as a set of distributed applications using Kubernetes and a microservice-led architecture. We are also utilising Kafka for our streaming and PACT for Contract testing. \n \n What you'll get to do: \n \n As aSenior SoftwareEngineeryou 'll play a key role within ...

Code. CI/CD using Jenkins, Azure DevOps or similar. Exposure to Node.js, TypeScript, Express.js or Nunjucks. Desirable: GOV/NHS or consultancy experience, Kafka and Helm. What's on Offer 25 days' holiday + public holidays Pension, private healthcare and life assurance Flexible benefits Cycle-to-work ...

tools such as Jenkins or Azure DevOps. Experience delivering scalable, high-quality digital solutions. Desirable Experience Consultancy, Government or NHS project experience. Knowledge of Kafka or other messaging systems. Knowledge of Helm. What's on Offer Competitive pension scheme. 25 days annual leave plus public holidays. Flexible benefits package ...

enterprise API integrations, and implementing agentic guardrails. Data Engineering (30%): Practical experience implementing components of data pipelines, including real-time streaming tools (AWS Kinesis, Kafka), data orchestration (dbt, Airflow), and managing vector databases for RAG architectures. Observability & Cost Management: SRE/Platform experience with the practical application of real ...

architectures (Azure, AWS, GCP). • Strong knowledge of performance testing methodologies and tools (such as JMeter, LoadRunner). Desirable Criteria • Knowledge of middleware systems (Kafka, IBM MQ). • Experience with ELK stack and reporting tools (e.g., Tableau). • Exposure to CI/CD tools (Github Actions, Jenkins) and version ...

. Proven experience testing functions and decision logic defined as code , including policy-as-code. Experience validating event-driven platforms (Pub/Sub, queues, Kafka, etc.) and batch processing. Experience with identity warehousing and protocols/formats for data ingestion including SCIM, REST API, LDAP, OIDC, and CSV . ...

Native Observability, Prometheus, Grafana, OpenTelemetry, Wiz, HashiCorp Vault, and CheckMarxOne or similar tools. Strong working knowledge of platform and data technologies including PostgreSQL, Redis, Kafka, Ping and/or Keycloak IAM, Kong APIM, Cloudflare, and application security best practices. What's in it for you? At TransUnion you will ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

cloud-native testing. Experience with identity protocols and technologies including SCIM, REST APIs, LDAP and OIDC. Knowledge of event-driven architectures (Pub/Sub, Kafka, queues) and policy-based access controls (RBAC, ABAC, ReBAC, PBAC). Proven ability to lead automation testing initiatives, mentor engineers, and engage with stakeholders. ...

deliver high quality software that you will be proud of. The Software Engineer will need the following technical experience:- Java React PostGres Kafka ElasticSearch AWS Ansible REST Docker API Gateways JavaScript Mongo SQL Security Clearance Due to the nature of our work, the successful candidate for this role will ...

joining an established business at the forefront of AI-native software engineering. Skills: • Java, Spring, REST APIs, AWS • Microservices and Distributed Systems • Kafka or RabbitMQ • TDD and CI/CD The money is good too – up to £82k plus benefits including remote first working with offices in Manchester, Leeds ...

full data engineering stack – from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise ...

legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI/ML workloads, including vector databases, feature stores ...

Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through ...

across the platform. Key Responsibilities Build high-volume, event-driven data ingestion pipelines across multiple Cloud Service Providers. Design and engineer streaming solutions using Kafka and Flink, with Java-based services and jobs. Deploy and operate cloud-based services with a focus on scalability, resilience, security and observability. Contribute …/CD, infrastructure automation and operational best practices. Essential Experience Proven experience delivering large-scale event-driven systems in production. Strong hands-on Kafka experience, including partitioning, consumer groups, ordering, schema evolution, retention and replay. Strong hands-on Flink or equivalent stream-processing experience, including stateful processing, checkpoints, back ...

refine and decompose work, manage dependencies, and remove technical blockers. Strong experience in microservices and API development. experience with asynchronous messaging technologies such as Kafka or similar event-driven platforms. experience in at least two or three of the following: API development SQL/Databases HTML/JavaScript Strong … delivery, including resolving blockers and prioritising work. Technologies Used Kotlin Java Microservices REST APIs SQL/Databases HTML/JavaScript Kafka and event-driven architecture technologies GitHub Jira Confluence What We Offer Exposure to leading IT technologies available in the market. Internal training events and workshops. In-house seminars ...

enable real‐time and batch data processing at scale. Responsibilities Drive platform capability improvements – continuously enhance distributed data platforms using knowledge of Spark, Databricks, Kafka, Pulsar, Cassandra, and object stores to maintain best‐in‐class capabilities. Enable application data consumption – understand how applications produce and consume data, designing solutions … access patterns, real‐time streaming, and batch processing for application needs. Architect data streaming solutions – design and implement real‐time data streaming architectures using Kafka and Pulsar, ensuring low‐latency data delivery to downstream applications and services. Design distributed data structures – work with engineering teams to design effective data ...

automation and configuration management Drive platform resilience,observability and operational maturity Support platform upgrades, governance and lifecycle management Event Streaming & Microservices Provide leadership across Kafka and event-driven technology platforms Establish standards for event streaming, resiliency, monitoring and governance Support engineering teams in adopting event-driven architectures and microservices … Lead Engineer, Senior Staff Engineer or equivalent Strong background in Cloud, Infrastructure or Platform Engineering Deep expertise in Kubernetes and container technologies Experience with Kafka and event streaming platforms Strong knowledge of private cloud technologies and enterprise virtualisation platforms such as VMware Excellent understanding of distributed systems, networking, scalability ...

across the client's private cloud platform, shaping and improving our virtualisation, container and Kubernetes capabilities, and enabling resilient, secure, high-performing services (including Kafka-based event streaming and microservices platforms). Reporting to the Head of Private Cloud, you'll partner closely with Product Owners, architects and engineering … turn strategy into practical, well-engineered outcomes. Key responsibilities Technical leadership & engineering excellence Set engineering direction for private cloud capabilities spanning virtualisation, containers, Kubernetes, Kafka/event streaming, and microservices enablement. Act as a senior technical authority, review designs, challenge assumptions, and ensure solutions are supportable, secure, and cost ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...