Senior Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- JP Morgan Chase
- Location
- Glasgow, Lanarkshire, United Kingdom
- Salary
- £ 80 K
operating or integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacksFamiliarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hostingExperience with online large language model quality monitoring, including hallucination detection ...