Machine Learning Engineer

Machine Learning Engineer

Whitehall Resources are looking for a Machine Learning Engineer. This role is hybrid working with 3 days per week onsite in South Yorkshire, and the remainder remote working, for an initial 5-month contract.

***Inside IR35***

Job Description:

Build the knowledge, retrieval, and evaluation layer that allows the AI helpdesk to answer accurately and safely.

Key Responsibilities:

- Build and maintain data pipelines for IT knowledge articles, SOPs, ticket history, and troubleshooting content.

- Develop RAG pipelines, embeddings, indexing, and retrieval optimization.

- Improve answer quality using chunking, ranking, filtering, and grounding techniques.

- Create evaluation datasets and automated quality tests for accuracy, hallucination, and task completion.

- Support model selection, tuning, and performance benchmarking.

- Work with engineering teams to improve response quality and reduce failure rates.

Required skill:

- Strong Python and data engineering skills.

- Run data quality testing, verify LLM results etc

- Experience with vector databases, embeddings, and retrieval systems.

- Experience building ETL/data pipelines for structured and unstructured data.

- Understanding of LLM evaluation, experimentation, and model performance metrics.

- Familiarity with SQL, APIs, and cloud data platforms.

- AWS (preferred), GCP exposure.

Preferred:

- Experience with enterprise knowledge systems and ticket datasets.

- Experience with fine-tuning, reranking, or search relevance optimization.