Benchmarking Project Lead, Siri Evaluation
- Location
- Cambridge, England, United Kingdom
pace. We are seeking a senior manager to help drive our evaluation efforts. The role will involve managing teams working on evaluation development and data science, and leading high-impact initiatives to bring state-of-the-art agentic evaluation to the whole Siri team. Description As part … plan benchmarking their accuracy on a wide range of features, locales, and platforms using humans in the loop. Responsibilities Design and execute efficient data collection processes using humans in the loop Lead annotation efforts for various languages and devices Plan and manage the budget of annotator resourcing with ...