Junior Research Scientist (AI Testing and Evaluation)

Location: London (Hybrid – min. 2 days/week in office)

Type: Full-Time, Permanent

Salary: £45,000

About Advai

Advai works with enterprises, government, and defence to test AI systems before they're deployed and monitor them after deployment. AI adoption is accelerating across the economy, government, and defence — our mission is to enable that, giving organisations the confidence to deploy AI safely and securely through evidence-based testing.

We're growing our research team and looking for motivated, curious Junior Research Scientists to work on high-impact AI evaluation across commercial, public sector, and defence use cases.

The Role

You'll work closely with customers to understand their AI use cases and testing needs, research and implement evaluations, and collaborate with our engineering team to integrate those tests into Advai's platform. You'll also contribute to internal research projects and play an active role in shaping the next generation of AI testing and monitoring capabilities.

Key Responsibilities

• Work directly with customers to understand their AI use cases and help formulate testing and evaluation requirements
• Research, design, and implement tests that rigorously evaluate AI systems across a range of domains
• Collaborate with Advai's engineering team to integrate new tests into our platform
• Contribute to internal and external research projects in AI testing, safety, and evaluation
• Help design and validate new automations and tooling for the Advai platform
• Stay current with developments in AI testing, monitoring, and the broader landscape of AI deployments
• Communicate findings clearly to both technical and non-technical stakeholders

Requirements

• Bachelor's or Master's degree in Machine Learning, Computer Science, or a related quantitative field
• Practical experience with Python and common AI/ML frameworks (e.g. PyTorch, Hugging Face, frontier AI APIs)
• Genuine passion for AI testing and monitoring
• Ability to engage confidently with customers and external stakeholders
• Curiosity and willingness to explore new research areas and learn quickly
• Strong collaborative skills across research, buisness and engineering teams
• Good written and verbal communication skills for technical reports and client-facing work

Nice to Have

• Exposure to adversarial AI, red teaming, robustness testing, or AI security evaluation
• Experience with Linux and remote computing environments
• Familiarity with version control and testing frameworks and other software engineering skills

Benefits

• Flexible hours with a hybrid working model (London office + remote)
• Private health and cycle to work scheme
• Professional development opportunities in the rapidly evolving field of AI
• A dynamic environment focused on enabling safe, confident AI deployment

We're committed to fostering a diverse and inclusive workplace and strongly encourage candidates from all backgrounds to apply.