5 of 5 Permanent Kafka Jobs in Leeds

enterprise API integrations, and implementing agentic guardrails. Data Engineering (30%): Practical experience implementing components of data pipelines, including real-time streaming tools (AWS Kinesis, Kafka), data orchestration (dbt, Airflow), and managing vector databases for RAG architectures. Observability & Cost Management: SRE/Platform experience with the practical application of real ...

Native Observability, Prometheus, Grafana, OpenTelemetry, Wiz, HashiCorp Vault, and CheckMarxOne or similar tools. Strong working knowledge of platform and data technologies including PostgreSQL, Redis, Kafka, Ping and/or Keycloak IAM, Kong APIM, Cloudflare, and application security best practices. What's in it for you? At TransUnion you will ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

enable real‐time and batch data processing at scale. Responsibilities Drive platform capability improvements – continuously enhance distributed data platforms using knowledge of Spark, Databricks, Kafka, Pulsar, Cassandra, and object stores to maintain best‐in‐class capabilities. Enable application data consumption – understand how applications produce and consume data, designing solutions … access patterns, real‐time streaming, and batch processing for application needs. Architect data streaming solutions – design and implement real‐time data streaming architectures using Kafka and Pulsar, ensuring low‐latency data delivery to downstream applications and services. Design distributed data structures – work with engineering teams to design effective data ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...