5 of 5 Contract Data Pipeline Jobs in South Yorkshire

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage … proactive insights). Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events. Build automated validation, replay, and backfill mechanisms for data reliability and recovery. Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms. Use LLMs to enhance observability capabilities (e.g., query assistance ...

specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Job Title: Data Engineer Location: Sheffield (Hybrid - 3 days per week onsite) Duration: Contract until 30/11/2026 Pay Rate: £326 per day all inc. … PAYE through FCSA Umbrella) CONTRACTOR MUST BE ELIGIBLE FOR BPSS Role Description: Key Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. ...

Type: 6-month contract (Inside IR35) Company Introduction: We are currently recruiting for an Engineering Tech Lead with experience in Data Engineering, OpenShift Telemetry, Kafka, Splunk, and LLM to join our global client in the financial services sector. Job Responsibilities/Objectives: . Design, implement, and maintain data … traces) at scale. . Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. . Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer. . Integrate processed telemetry into Splunk for visualisation ...

Sheffield (3 days on-site per week) Candidates must be eligible for BPSS clearance We're looking for a highly skilled Senior Data & Observability Engineer to design, build, and evolve large-scale telemetry and observability capabilities across modern cloud platforms. This role is ideal for someone who thrives … high-volume, real-time data environments and enjoys solving complex engineering challenges. What You'll Do Design, implement, and maintain scalable data pipelines to ingest and process telemetry (metrics, logs, traces) from OpenShift and Kubernetes platforms. Stream telemetry via Kafka-managing producers, topics, schemas, and building ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage ...