5 of 5 vLLM Jobs in Scotland

upgrades, node drain states, and control plane troubleshooting. Familiarity with the inference and training stack that ML platform teams build on, such as vLLM, SGLang, TensorRT-LLM, or NCCL, and with how benchmarks such as MLPerf are run and reported. Experience writing for both the platform engineers who operate ...

field. Strong knowledge of distributed systems, operating systems,machine learning systems architecture, Inference serving, and AI Infrastructure. Hands-on experience withLLM serving frameworks(e.g.,vLLM,Ray Serve,TensorRT-LLM,TGI) anddistributed KV cache optimization. Proficiency inC/C++, with additional experience inPythonfor research prototyping. Solid grounding insystems research methodology,distributed ...

make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability.* Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. … experience in:* Linux, application and server administration* Containers and container orchestration, such as Docker and Kubernetes* AI inference and model serving platforms, such as vLLM, SGLang or similar* AI gateways and API management, such as LiteLLM, Bifrost or similar* GPU workloads, including performance, utilisation and resource management* Programming and scripting ...

make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability. Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. … experience in: Linux, application and server administration Containers and container orchestration, such as Docker and Kubernetes AI inference and model serving platforms, such as vLLM, SGLang or similar AI gateways and API management, such as LiteLLM, Bifrost or similar GPU workloads, including performance, utilisation and resource management Programming and scripting ...

checks to simplify adoption and day‐to‐day use Engineer and operate production large language model inference services using modern serving engines such as vLLM, TensorRT‐LLM, SGLang, LLM‐D, or equivalent systems Drive Kubernetes‐based deployment patterns, scaling strategies, networking approaches, and troubleshooting practices to support reliable platform operations … software development kits, libraries, templates, and automated checks to improve platform adoption Deep, hands‐on experience with large language model inference systems such as vLLM, TensorRT‐LLM, SGLang, LLM‐D, or equivalent production serving engines Hands‐on experience building and operating production services on public cloud platforms such ...