Senior Lead Software Engineer - LLM Ops Platform Reliability
- Location
- Auchentibber, Scotland, United Kingdom
building AI agents using orchestration frameworks such as LangChain, LangGraph, CrewAI, or similar platforms Experience operating or integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacks Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed … detection, toxicity filtering, and drift detection using open telemetry conventions Contributions to open-source large language model serving or inference projects, (vLLM, llm-d, Ray, KServe, Triton) #J-18808-Ljbffr ...