AI Quality and Evaluation Manager
London, United Kingdom
Hybrid / WFH Options
Hybrid / WFH Options
Lorien
AI Quality & Evaluation Manager (Contract) Location: Hybrid working - Blackfriars 3 days per week Contract: 6 months, Outside IR35 Are you passionate about building the future of AI quality? Do you thrive in hands-on roles where you can shape frameworks from the ground up and make a real impact? We're looking for an experienced AI Quality & Evaluation Manager to join our team on a contract basis and lay the foundations for robust, reliable, and user-focused AI services across our business. What You'll Do Design and implement a comprehensive AI testing and evaluation framework for all AI solutions, including LLM-based tools, RAG systems, and third-party platforms. Define and document quality … internal staff to sustain the framework after your contract ends. Support vendor evaluations and POC assessments with robust test protocols. Establish baseline metrics and dashboards to measure ongoing AI quality and relevance. Work closely with engineering and product leads to embed testing into delivery workflows. Champion responsible AI practices to ensure fairness, transparency, and user trust. What You'll More ❯
Employment Type: Contract
Rate: GBP Annual
Posted: