Research Engineer, Evals - Member of Technical Staff
- Location
- Greater London, England, United Kingdom
analyse and evaluate agentic systems rigorously enough to say where and why they go wrong, and we use what we learn to design better ones. We are not simply building a better harness; the best harness will change with every new model, task and generation of silicon. … Evaluations or benchmarks you built that other people went on to use Broad training in empirical method, potentially from a field outside machine learning – experimental design, Bayesian inference, model selection, significance testing, uncertainty quantification Experience with automated grading and model-based judging, and a rigorous account of ...