5 of 5 Remote/Hybrid Human-in-the-Loop Jobs in the North of England

powered solutions. Design, implement, and maintain evaluation frameworks for AI systems, including regression testing, evaluation datasets, LLM‐as‐judge methodologies, and human‐in‐the‐loop review processes. Ensure AI‐powered software solutions meet the same standards for quality, reliability, security, and testing as traditional software ...

actions. Advise on secure patterns for AI application development, including permission boundaries, identity controls, sandboxing, auditability, input/output validation and human-in-the-loop controls. Help clients establish governance and assurance processes for AI systems across the lifecycle, from experimentation through to production deployment. ...

level risk.* **Agentic AI systems:** Creating graph-based, multi-step workflows using loops, branching, routing, tool use, state management, retries and human-in-the-loop controls.* **Evaluation:** Using regression sweeps, canary testing and LLM-as-judge scoring to determine what is ready to ship.* **ML infrastructure ...

work Our non-negotiable principles are to protect clients from risk, use AI to amplify human capability, keep a human in the loop for consequential outputs, validate AI-generated work, and maintain an audit trail for transformations, decisions and releases. No unsanitised client data enters ...

agent is the right solution, when a process needs to change first, when automation could create risk, and when a human‐in‐the‐loop approach is more appropriate. You’ll be expected to think about: How an AI agent should behave in real customer ...