3 of 3 Observability Jobs in the City of Westminster

tool-calling patterns Extend the MCP server with new tools and capabilities Enforce structured outputs and validation across LLM boundaries 2. LLM Quality, Evals & Observability Build the layer that lets the team ship LLM features with confidence. You will: Design and grow the eval platform - golden datasets, regression suites … judge Integrate observability and tracing across providers and prompt versions Track cost, latency, and quality per prompt, model, and client Build guardrails for prompt injection, PII, and output safety Drive prompt engineering practice - versioning, A/B testing, platform overlays 3. Cloud & Data Infrastructure Own the cloud substrate that runs ...

tool-calling patterns Extend the MCP server with new tools and capabilities Enforce structured outputs and validation across LLM boundaries 2. LLM Quality, Evals & Observability Build the layer that lets the team ship LLM features with confidence. You will: Design and grow the eval platform - golden datasets, regression suites … judge Integrate observability and tracing across providers and prompt versions Track cost, latency, and quality per prompt, model, and client Build guardrails for prompt injection, PII, and output safety Drive prompt engineering practice - versioning, A/B testing, platform overlays 3. Cloud & Data Infrastructure Own the cloud substrate that runs ...

Purpose of the role: Capita's MuleSoft Centre for Enablement & Excellence (C4EE) is expanding its architectural capability to support large-scale integration and API transformation programmes for major UK Government and private-sector clients. As ...