Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- Jobleads-UK
- Location
- Glasgow, Scotland, United Kingdom
Experience building AI agents using frameworks such as LangChain, CrewAI, LangGraph, or similar orchestration platforms Experience operating or integrating serving platforms such as KServe, Ray Serve, NVIDIA Triton Inference Server, Text Generation Inference (TGI), alongside vLLM/llm‐d Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock … monitoring (e.g., hallucination, toxicity, drift detection) and tracing via OpenTelemetry conventions Contributions to open‐source LLM serving or inference projects (e.g., vLLM, llm‐d, Ray, KServe, Triton) #J-18808-Ljbffr ...