3 of 3 Permanent Open Source Jobs in Glasgow

serving infrastructure (such as vLLM and llm‐d), including model hosting, request routing, continuous batching, and KV‐cache optimization Deploy, host, and lifecycle‐manage open‐source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on‐prem and local GPU clusters, using reproducible infrastructure … Amazon Bedrock for managed model hosting Experience with online LLM quality monitoring (e.g., hallucination, toxicity, drift detection) and tracing via OpenTelemetry conventions Contributions to open‐source LLM serving or inference projects (e.g., vLLM, llm‐d, Ray, KServe, Triton) #J-18808-Ljbffr ...

postmortems for high‐availability services Deep understanding of distributed system design principles, networking (TCP/IP, DNS, load balancing), and Linux internals Contributions to open‐source observability or telemetry projects Experience working with agent control planes and management protocols; hands‐on knowledge of OpAMP is highly desirable #J ...

blameless postmortems for high-availability services Deep understanding of distributed system design principles, networking (TCP/IP, DNS, load balancing), Linux internals. Contributions to open-source observability or telemetry projects. Experience working with agent control planes and management protocols. Hands‐on knowledge of OpAMP is highly desirable. ...