Quality Engineer
- Location
- Greater London, England, United Kingdom
validate MCP Servers and related AI systems Design and implement evaluation strategies for LLM accuracy, safety, and reliability Create automated tests using Python, Pytest, and BDD frameworks Build quality gates into CI/CD pipelines to maintain continuous assurance Identify and address agentic AI failure modes such as hallucination, latency … Maintain documentation for test cases, evaluation pipelines, and validation strategies Requirements Strong programming experience in Python applied to test automation and evaluation Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines Understanding of common agentic ...