Senior Lead Software Engineer - LLM Ops Platform Reliability
- Location
- Auchentibber, Scotland, United Kingdom
integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacks Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online large language model quality monitoring, including hallucination detection ...