AI Quality Engineer
- Location
- Greater London, England, United Kingdom
automation, AI evaluation, CI infrastructure and investigation of complex test and quality issues. Key Responsibilities: Enhance and run layered evaluation frameworks, including automated checks, LLM-as-judge scoring, defined rubrics and targeted human review. Maintain versioned golden datasets to ensure evaluations remain reproducible and auditable. Monitor key quality signals across … Genuine interest in the challenges involved in testing non-deterministic AI output. At aSenior Level: It would be beneficial to also have experience of: LLM evaluation. Rubric design. LLM-as-judge approaches. AI regression testing. Evaluation harnesses. Improving quality practices across teams. Benefits include: Employee shares and equity programme, giving ...