LLM Evaluator / Content writer

LLM Evaluator / Content writer - Pure Remote (UK based) - 3-6 Months - Market rates

Robert Half are working on a high profile project and require a number of LLM Evaluators / Content writers

This role involves designing and writing effective prompts and evaluating LLM-generated content. Candidates should have a Bachelor's degree and over 3 years of experience in content writing.

This is a pure remote role

Responsibilities:

• Design and write effective prompts that elicit desired responses from LLMs, considering different tasks, contexts, and target audiences.
• Generate creative and informative text formats, including stories, articles, summaries, dialogues based on guidelines.
• Evaluate and compare the quality of LLM-generated responses based on criteria such as fluency, coherence, factuality, creativity, and bias.
• Analyze LLM outputs to identify strengths and weaknesses, and provide feedback to improve model performance.
• Collaborate with engineers, researchers, and product managers to refine prompting strategies and evaluation metrics.
• Contribute to the development of best practices and guidelines for prompt engineering and LLM evaluation.

Qualifications:

• Bachelor's degree in English, Creative Writing, Linguistics, Computer Science, or a related field.
• 3+ years of experience in content writing, copywriting, or a related field.
• Strong understanding of LLM capabilities and limitations.
• Excellent writing and editing skills, with the ability to adapt to different styles and tones.
• Experience with prompt engineering and evaluating LLM outputs is a plus.
• Understanding of statistics and data analysis is a plus.
• Familiarity with data annotation and labeling tools is a plus.
• Strong analytical and problem-solving skills.
• Ability to work independently and as part of a team.
• Can-do attitude, willingness to learn, and growth mindset.

LLM Evaluator / Content writer - Pure Remote (UK based) - 3-6 Months - Market rates

Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: gb/en/privacy-notice.