9 of 9 Remote/Hybrid vLLM Jobs in the UK excluding London

/GenAI platform engineering specifically. You don’t need to tick every box.AI & GenAI Platform Engineering• Model serving and gateway infrastructure (e.g. vLLM, LiteLLM, managed endpoints), with routing, failover, and per-workload cost attribution• Agent orchestration and tool-calling frameworks (e.g. LangGraph or equivalent), including familiarity with the Model Context ...

/GenAI platform engineering specifically. You don’t need to tick every box. AI & GenAI Platform Engineering • Model serving and gateway infrastructure (e.g. vLLM, LiteLLM, managed endpoints), with routing, failover, and per-workload cost attribution • Agent orchestration and tool-calling frameworks (e.g. LangGraph or equivalent), including familiarity with the Model ...

also be interested to hear about any experience you have in the following areas: Experience with ML frameworks and LLM inference, such as PyTorch, vLLM, SGLang, llama. cpp or similar Experience analysing and optimizing CPU performance in heterogeneous CPU + accelerator systems Familiarity with agentic AI frameworks and protocols Understanding ...

with distributed computing frameworks (e.g., Ray, Spark), or specialised batch schedulers/resource managers (e.g., Slurm, Volcano, Kueue). Demonstratedexpertisewith specialised serving engines (e.g.,vLLM,SGLang) or techniques for deploying models in resource-constrained or high-throughput environments. Familiarity withGitOpsand CI/CD (e.g.,ArgoCD,GitHubActions). Experience managing ...

management in development tools and software including CLIs, SDKs and APIs. Knowledge of machine learning frameworks, runtimes, infrastructure such as PyTorch, ONNX, ExecuTorch, Llama.cpp, vLLM and LiteRT. Understanding of model deployment to edge, embedded or heterogeneous computing, with an understanding of trade-offs between accuracy, performance and power consumption. ...

also be interested to hear about any experience you have in the following areas: Experience with ML frameworks and LLM inference , such as PyTorch, vLLM, SGLang, llama.cpp or similar Experience analysing and optimizing CPU performance in heterogeneous CPU + accelerator systems Familiarity with agentic AI frameworks and protocols Understanding ...

Skills and Experience : Experience using software simulators and/or FPGAs Exposure to any of the following: driver development, inference engines like llama.cpp or vLLM, performance analysis of ML and GenAI workloads, knowledge of Neural Network Processing Units (NPU) or Graphics Processing Units (GPU) and how they are used ...

make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability.* Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. … experience in:* Linux, application and server administration* Containers and container orchestration, such as Docker and Kubernetes* AI inference and model serving platforms, such as vLLM, SGLang or similar* AI gateways and API management, such as LiteLLM, Bifrost or similar* GPU workloads, including performance, utilisation and resource management* Programming and scripting ...

make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability. Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. … experience in: Linux, application and server administration Containers and container orchestration, such as Docker and Kubernetes AI inference and model serving platforms, such as vLLM, SGLang or similar AI gateways and API management, such as LiteLLM, Bifrost or similar GPU workloads, including performance, utilisation and resource management Programming and scripting ...