6 of 6 Kafka Jobs in Yorkshire

cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and Terraform. What ...

have knowledge on Agents and Job Schedulers Must have knowledge on Channels implementation. Must have knowledge on skin rules implementation. Must have knowledge on Kafka, Kubernetes and Cloud technologies Must have knowledge on Blueprint, Gen-AI, Knowledge Buddy integrations ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs … data pipelines and observability platforms. Document data flows, schemas, dashboards, and operational runbooks. Required Skills: Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect/KSQL/KStream). Proficiency with OpenShift/Kubernetes telemetry (OpenTelemetry, Prometheus) and CLI tooling. Experience ...

eligible My client is seeking a Data Engineer to design and operate large-scale telemetry and observability data pipelines within a modern OpenShift and Kafka ecosystem. This role is central to enabling proactive, Level 4 observability, delivering high-quality metrics, logs, and traces to support platform reliability, operational insight … automation. Responsibilities: * Design, implement and maintain scalable data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) * Stream telemetry through Kafka (producers, topics, schemas) and build resilient consumer services for enrichment and transformation * Engineer multi-tenant observability data models, ensuring data lineage, quality controls and SLAs across streaming ...

real impact on platform reliability and insight. What you’ll be doing: Building and supporting telemetry pipelines for metrics, logs, and traces Developing Kafka producers and consumers, managing schemas and topics Contributing to resilient streaming and enrichment services Integrating telemetry into Splunk for dashboards and alerting Implementing OpenTelemetry … logging Helping shape schema governance with Avro/Protobuf Collaborating with Platform & SRE teams to improve observability and SLOs Key Skills & Experience: Hands-on Kafka experience (producers/consumers, schema registry) Knowledge of OpenShift/Kubernetes telemetry (Otel, Prometheus) Experience sending data into Splunk Strong Python skills for data ...