LLM Evaluator STEM

LLM Evaluator (STEM) - Pure Remote (UK based) - 3-6 Months - Market rates

Robert Half are working on a high profile project and require a number of STEM LLM Evaluators.

We require candidates that hold a Masters degree in a STEM subject and an interest in AI.

This is a pure remote role

Responsibilities:

1. High-Quality Data Creation & Curation:
   • Ensure all content adheres strictly to established quality rubrics, style guides, and pedagogical standards, focusing on accuracy, clarity, and effectiveness.
   • Integrate subject matter expertise to provide comprehensive and insightful explanations that anticipate common student misconceptions.
2. AI Response Evaluation & Feedback:
   • Rigorously evaluate AI-generated responses for correctness, coherence, pedagogical soundness, and adherence to specific instructions.
   • Provide clear, constructive, and actionable feedback to the AI model, identifying errors, inaccuracies, or areas for improvement in its reasoning and presentation.
   • Participate in creating "ground truth" solutions and evaluation datasets to benchmark AI model performance.
3. Subject Matter Expertise Application:
   • Apply deep knowledge in [Maths/Physics/Chemistry/Biology/Coding/Finance] to assess complex problems, verify solutions, and develop alternative approaches.
   • Stay updated with advancements and common curriculum standards in your respective STEM field to ensure content relevance and accuracy.

Qualifications:

• Masters Degree in STEM subject
• Teaching/Content Creation Experience: Proven experience (7+ years) in teaching, tutoring, content writing, or academic research in your specialized STEM field. Experience with competitive exam preparation is highly valued

Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: gb/en/privacy-notice.