ML/AI Test Analyst
City of London, London, United Kingdom
Valcon
and model outputs, and driving quality throughout the AI/ML lifecycle. The ideal candidate will combine strong problem-solving abilities with a deep understanding of data science, software testing, and automation frameworks. Key Responsibilities: Diagnose and debug failures in AI systems, including technical bugs, data quality issues, or model limitations. Design and implement creative test scenarios that push … impact of model behavior on end-user experience and business objectives. Create, manage, and validate large and diverse test datasets, including synthetic and adversarial data. Automate model and API testing using frameworks such as pytest, unittest, or behave. Collaborate with data scientists and engineers to understand ML pipeline components and potential failure points. Evaluate model robustness against noisy, manipulated … or adversarial inputs. Perform load and performance testing on deployed ML models to ensure production readiness. Conduct UAT (User Acceptance Testing) and manage defect triaging and resolution. Create and maintain detailed test plans, test cases, and test scripts. Report test coverage, defects, and progress via tools such as Jira and test dashboards. Contribute to test strategy and drive More ❯
Posted: