18 of 18 vLLM Jobs in the UK excluding London

/GenAI platform engineering specifically. You don’t need to tick every box.AI & GenAI Platform Engineering• Model serving and gateway infrastructure (e.g. vLLM, LiteLLM, managed endpoints), with routing, failover, and per-workload cost attribution• Agent orchestration and tool-calling frameworks (e.g. LangGraph or equivalent), including familiarity with the Model Context ...

/GenAI platform engineering specifically. You don’t need to tick every box. AI & GenAI Platform Engineering • Model serving and gateway infrastructure (e.g. vLLM, LiteLLM, managed endpoints), with routing, failover, and per-workload cost attribution • Agent orchestration and tool-calling frameworks (e.g. LangGraph or equivalent), including familiarity with the Model ...

with ambiguity and wants ownership. Desirable (or willing to learn) Experience with LLMs: fine-tuning (LoRA/PEFT/full), serving and hosting (e.g. vLLM, TGI, Ollama), and distributed or multi-GPU training. Familiarity with GPUs, cloud, and containers (Docker, etc.). Background in optimisation, Bayesian methods, reinforcement learning ...

also be interested to hear about any experience you have in the following areas: Experience with ML frameworks and LLM inference, such as PyTorch, vLLM, SGLang, llama. cpp or similar Experience analysing and optimizing CPU performance in heterogeneous CPU + accelerator systems Familiarity with agentic AI frameworks and protocols Understanding ...

with hardware/software co-design, or with hardware performance modelling and simulation. Contributions to performance-critical open-source projects (e.g. PyTorch, Triton, JAX, vLLM). A collaborative and supportive work environment The opportunity to have a high impact in a growing organisation Competitive salary package and pension Professional development ...

with distributed computing frameworks (e.g., Ray, Spark), or specialised batch schedulers/resource managers (e.g., Slurm, Volcano, Kueue). Demonstratedexpertisewith specialised serving engines (e.g.,vLLM,SGLang) or techniques for deploying models in resource-constrained or high-throughput environments. Familiarity withGitOpsand CI/CD (e.g.,ArgoCD,GitHubActions). Experience managing ...

management in development tools and software including CLIs, SDKs and APIs. Knowledge of machine learning frameworks, runtimes, infrastructure such as PyTorch, ONNX, ExecuTorch, Llama.cpp, vLLM and LiteRT. Understanding of model deployment to edge, embedded or heterogeneous computing, with an understanding of trade-offs between accuracy, performance and power consumption. ...

also be interested to hear about any experience you have in the following areas: Experience with ML frameworks and LLM inference , such as PyTorch, vLLM, SGLang, llama.cpp or similar Experience analysing and optimizing CPU performance in heterogeneous CPU + accelerator systems Familiarity with agentic AI frameworks and protocols Understanding ...

Skills and Experience : Experience using software simulators and/or FPGAs Exposure to any of the following: driver development, inference engines like llama.cpp or vLLM, performance analysis of ML and GenAI workloads, knowledge of Neural Network Processing Units (NPU) or Graphics Processing Units (GPU) and how they are used ...

upgrades, node drain states, and control plane troubleshooting. Familiarity with the inference and training stack that ML platform teams build on, such as vLLM, SGLang, TensorRT-LLM, or NCCL, and with how benchmarks such as MLPerf are run and reported. Experience writing for both the platform engineers who operate ...

field. Strong knowledge of distributed systems, operating systems,machine learning systems architecture, Inference serving, and AI Infrastructure. Hands-on experience withLLM serving frameworks(e.g.,vLLM,Ray Serve,TensorRT-LLM,TGI) anddistributed KV cache optimization. Proficiency inC/C++, with additional experience inPythonfor research prototyping. Solid grounding insystems research methodology,distributed ...

correctness and maintainability. Python, C++, Rust or other relevant systems or scientific programming experience can provide a route into the role. Familiarity with vLLM or SGLang, simulator frameworks, or hardware performance tools would be useful. Depth in a subset of these areas is sufficient; languages and frameworks will follow ...

results against stated application requirements. Practical experience using AI coding agents, with the judgement to validate generated code, data transformations and evaluations. Experience with vLLM, SGLang or similar serving software, long-context workloads, agentic applications, trace analysis or quality evaluation would be valuable. Depth in a subset is sufficient. ...

make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability.* Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. … experience in:* Linux, application and server administration* Containers and container orchestration, such as Docker and Kubernetes* AI inference and model serving platforms, such as vLLM, SGLang or similar* AI gateways and API management, such as LiteLLM, Bifrost or similar* GPU workloads, including performance, utilisation and resource management* Programming and scripting ...

make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability. Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. … experience in: Linux, application and server administration Containers and container orchestration, such as Docker and Kubernetes AI inference and model serving platforms, such as vLLM, SGLang or similar AI gateways and API management, such as LiteLLM, Bifrost or similar GPU workloads, including performance, utilisation and resource management Programming and scripting ...

Opportunity We are seeking a Senior Software Engineer with a passion for open-source AI infrastructure to work on deploying, extending and optimising vLLM (and potentially other inference serving engines) to support our projects. You will play a crucial, high-impact role across both our key programmes, the Scaling Inference … autonomous agents for software development. What You'll Do Deploy, instrument and monitor open weight models served using vLLM. Implement new features within vLLM to support novel hardware architectures as part of the Scaling Inference Lab. Work with the Panopticon team to identify opportunities to extend vLLM to enhance accuracy ...

checks to simplify adoption and day‐to‐day use Engineer and operate production large language model inference services using modern serving engines such as vLLM, TensorRT‐LLM, SGLang, LLM‐D, or equivalent systems Drive Kubernetes‐based deployment patterns, scaling strategies, networking approaches, and troubleshooting practices to support reliable platform operations … software development kits, libraries, templates, and automated checks to improve platform adoption Deep, hands‐on experience with large language model inference systems such as vLLM, TensorRT‐LLM, SGLang, LLM‐D, or equivalent production serving engines Hands‐on experience building and operating production services on public cloud platforms such ...

stack. Investigate efficient execution of workloads across multiple NPUs, including compute/communication overlap and minimizing host-side overhead. Work with AI frameworks like vLLM/SGLang, inference systems and accelerator software stacks to prototype and evaluate new runtime mechanisms. Collaborate with researchers and engineers working across frameworks, compilers, runtime … programming environments such as CUDA, ROCm, OpenCL or CANN/Ascend. Experience with AI frameworks or inference/serving systems such as PyTorch, vLLM, SGLang, ONNX Runtime, or similar systems. Experience with profiling and performance-analysis tools for CPUs, GPUs or NPUs. Knowledge of multi-device or distributed execution, collective ...