Lead Software Engineer - LLM Ops Platform Reliability (AI and Machine Learning Platform)
- Hiring Organisation
- Hackajob Ltd
- Location
- Glasgow, Scotland, United Kingdom
- Employment Type
- Permanent Contract, On-site
integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacks Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online large language model quality monitoring, including hallucination detection ...