1 of 1 Permanent Ray Jobs in Glasgow

Lead Software Engineer - LLM Ops Platform Reliability

Hiring Organisation
Jobleads-UK
Location
Glasgow, Scotland, United Kingdom
Experience building AI agents using frameworks such as LangChain, CrewAI, LangGraph, or similar orchestration platforms Experience operating or integrating serving platforms such as KServe, Ray Serve, NVIDIA Triton Inference Server, Text Generation Inference (TGI), alongside vLLM/llm‐d Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock … monitoring (e.g., hallucination, toxicity, drift detection) and tracing via OpenTelemetry conventions Contributions to open‐source LLM serving or inference projects (e.g., vLLM, llm‐d, Ray, KServe, Triton) #J-18808-Ljbffr ...