3 of 3 Contract Data Modelling Jobs in South Yorkshire

Data Engineer (Contract) 9+ Month Contract based in Sheffield £395 - £442 per day InsideIR35 BPSS clearance required - candidates must be eligible My client is seeking a Data Engineer to design and operate large-scale telemetry and observability data pipelines within a modern OpenShift and Kafka ecosystem. This … Level 4 observability, delivering high-quality metrics, logs, and traces to support platform reliability, operational insight, and automation. Responsibilities: * Design, implement and maintain scalable data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) * Stream telemetry through Kafka (producers, topics, schemas) and build resilient consumer services for enrichment ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality … proactive insights). Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events. Build automated validation, replay, and backfill mechanisms for data reliability and recovery. Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms. Use LLMs to enhance observability capabilities (e.g., query assistance, anomaly ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality ...