1 of 1 vLLM Jobs in Glasgow

reliability, performance, and cost‐efficiency of the LLM inference platform end to end. You will operate large language model serving stacks (such as vLLM and llm‐d) in production at scale, with deep instrumentation and strong operational rigor. You will partner across engineering to deliver secure software, improve stability … infrastructure Build backend services and APIs that enable reliable operation of AI infrastructure in production Operate and scale LLM serving infrastructure (such as vLLM and llm‐d), including model hosting, request routing, continuous batching, and KV‐cache optimization Deploy, host, and lifecycle‐manage open‐source and proprietary LLMs on Amazon ...