20 of 20 Remote/Hybrid Human-in-the-Loop Jobs in the UK excluding London

client GxP and trust by design: Partner with Quality & Compliance on the validation path for regulated AI use cases: human-in-the-loop decisions, audit trails, reproducibility, guardrails and computer system validation evidence. Evaluation and operations: Define test sets and accuracy measures, monitor quality, cost ...

delivery of the agentic framework transforming security services across the Chief Security Office — agent authorisation models, tool-invocation control, human-in-the-loop gates, trust boundaries and runtime monitoring, designed in from inception. Own the design-to-build-to-handover pipeline: specifications ...

engineering workflows for AI solutions. Support MLOps processes, including model training, testing and production deployment. Build user-facing Copilot experiences and human-in-the-loop review workflows. Create evaluation frameworks, testing suites and observability for AI services. Leverage AI-assisted development tools to enhance code quality ...

tracing. Experience automating scientific or technical workflows with agents: data pipelines from lab and process systems, code generation for analysis, and human-in-the-loop review. Daily use of AI coding agents (Claude Code, GitHub Copilot, Databricks AI Assistant) as the primary mode of development. ...

development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies such as caching, model ...

LangGraph, including event-driven automation triggered by monitoring and observability signals.Understanding of AI control-plane design, including agent permissions, oversight and human-in-the-loop workflows.Knowledge and Data ArchitectureExperience designing knowledge taxonomies or graphs that connect documentation, incident history, automations and agent capabilities.Experience applying “as-code ...

level, including having chosen an existing managed or purchased capability over building something custom, and having defended that call. Experience designing human-in-the-loop workflows, including determining where approval steps belong before an AI solution acts. Strong communication skills, with the ability to represent ...

stateful multi-agent workflows using Google ADK , LangChain, LangGraph, AWS Bedrock, or equivalent technologies, incorporating structured outputs, tool calling, and human-in-the-loop steps. Evaluation & Benchmarking: Implement automated offline and online evaluation suites using tools such as Braintrust, AgentCore Eval, equivalent industry solutions, or custom ...

powered solutions. Design, implement, and maintain evaluation frameworks for AI systems, including regression testing, evaluation datasets, LLM‐as‐judge methodologies, and human‐in‐the‐loop review processes. Ensure AI‐powered software solutions meet the same standards for quality, reliability, security, and testing as traditional software ...

actions. Advise on secure patterns for AI application development, including permission boundaries, identity controls, sandboxing, auditability, input/output validation and human-in-the-loop controls. Help clients establish governance and assurance processes for AI systems across the lifecycle, from experimentation through to production deployment. ...

investigation and incident summarisation, automated playbooks, and agentic response actions. A good candidate will be clear-eyed about limits: where human-in-the-loop controls are needed, how to validate AI outputs, and how to avoid automating mistakes at speed. The ability to build ...

level risk.* **Agentic AI systems:** Creating graph-based, multi-step workflows using loops, branching, routing, tool use, state management, retries and human-in-the-loop controls.* **Evaluation:** Using regression sweeps, canary testing and LLM-as-judge scoring to determine what is ready to ship.* **ML infrastructure ...

assistants that explain trends, flag issues and answer questions. Process automation: Automate manual, repetitive steps across business tools, documents and spreadsheets. Human-in-the-loop automations: Build supervised automations and agents where people review and approve outputs before they are used. Data pipelines and integrations: Build ...

work Our non-negotiable principles are to protect clients from risk, use AI to amplify human capability, keep a human in the loop for consequential outputs, validate AI-generated work, and maintain an audit trail for transformations, decisions and releases. No unsanitised client data enters ...

agent is the right solution, when a process needs to change first, when automation could create risk, and when a human‐in‐the‐loop approach is more appropriate. You’ll be expected to think about: How an AI agent should behave in real customer ...

each engagement. Use AI coding assistants as the default mode of building; provide judgement, course correction, and validation. Design human‐in‐the‐loop workflows for document authoring and review — approval gates, inline SME review and feedback capture, confidence‐based escalation, and full audit trails suitable … TypeScript/JavaScript, Go, or similar. Hands‐on experience with GenAI patterns: retrieval‐augmented generation (RAG), agents, document authoring and generation, human‐in‐the‐loop review design, and agent/LLM evaluation (eval datasets, automated and expert‐in‐the‐loop scoring, regression testing ...

quality control, and execution of AI-assisted security workflows.Working alongside the Security Automation & AI Engineering team, the Specialist manages \"Human-in-the-Loop\" (HITL) triage queues, maintains and updates knowledge bases feeding generative models, audits AI outputs for accuracy, and ensures prioritized investigation tasks … routed seamlessly to front-line security analysts and consultants.**Key Responsibilities****1. AI Workflow Supervision & Human-in-the-Loop (HITL) Routing*** Review and validate low-confidence alert enrichments, threat summaries, and triage recommendations generated by AI agents.* Assign, dispatch, and track complex security investigations, policy changes ...

control, and execution of AI-assisted security workflows. Working alongside the Security Automation & AI Engineering team, the Specialist manages "Human-in-the-Loop" (HITL) triage queues, maintains and updates knowledge bases feeding generative models, audits AI outputs for accuracy, and ensures prioritized investigation tasks … routed seamlessly to front-line security analysts and consultants. Key Responsibilities 1. AI Workflow Supervision & Human-in-the-Loop (HITL) Routing Review and validate low-confidence alert enrichments, threat summaries, and triage recommendations generated by AI agents. Assign, dispatch, and track complex security investigations, policy changes ...

Monzo is building an autonomous, human-in-the-loop ML system to transform customer support. You will lead the design and deployment of ML models including LLMs, RAG, and sequence-based architectures, and partner with a cross-functional squad to deliver high-impact solutions in ...

Technology Design AI-driven features with a clear understanding of where AI helps and where it introduces risk — prompts, fallbacks, and human-in-the-loop moments included Bring a genuine perspective on how the interfaceswe'rebuilding today might become obsolete — and what should replace them … those signals to drive the next iteration Strong candidates may also have: Experience shipping AI-driven features — prompts, fallbacks, human-in-the-loop moments — not just awareness of the concepts Familiarity with design tokens, contribution models, and what it means to design ...