4 of 4 Permanent Open Source Jobs in Scotland

serving infrastructure (such as vLLM and llm‐d), including model hosting, request routing, continuous batching, and KV‐cache optimization Deploy, host, and lifecycle‐manage open‐source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on‐prem and local GPU clusters, using reproducible infrastructure … Amazon Bedrock for managed model hosting Experience with online LLM quality monitoring (e.g., hallucination, toxicity, drift detection) and tracing via OpenTelemetry conventions Contributions to open‐source LLM serving or inference projects (e.g., vLLM, llm‐d, Ray, KServe, Triton) #J-18808-Ljbffr ...

postmortems for high‐availability services Deep understanding of distributed system design principles, networking (TCP/IP, DNS, load balancing), and Linux internals Contributions to open‐source observability or telemetry projects Experience working with agent control planes and management protocols; hands‐on knowledge of OpAMP is highly desirable #J ...

containerised and GPU enabled environments Supporting AI implementation programmes from proof of concept through to enterprise deployment and optimisation Evaluating and selecting technologies across open source and commercial platforms Designing and integrating AI solutions into existing enterprise systems and applications Working with AI Engineers, Data Scientists and technical ...

blameless postmortems for high-availability services Deep understanding of distributed system design principles, networking (TCP/IP, DNS, load balancing), Linux internals. Contributions to open-source observability or telemetry projects. Experience working with agent control planes and management protocols. Hands‐on knowledge of OpAMP is highly desirable. ...