Senior QA Automation Engineer - AI
- Location
- Greater London, England, United Kingdom
agentic workflows. Develop robust, end-to-end automated test suites in Python across evaluations, API checks, UI checks, and performance tests. Create automated prompt testing systems and regression suites to proactively detect unintended changes in model behaviour. Establish multi-dimensional evaluation criteria to measure and track GenAI quality across … Perform adversarial testing (red‐teaming) to identify and mitigate model hallucinations, biases, or security vulnerabilities. Develop internal tools and testing frameworks that enable software engineering teams to seamlessly validate their own GenAI implementations. Deploy real‐time monitoring and alerting systems to quickly detect and flag quality degradation ...