Senior Software Engineer - Open-Source AI Inference & vLLM
- Location
- Cambridge, England, United Kingdom
/AI projects (e.g. PyTorch, Hugging Face TGI, TensorRT-LLM, Ray). Strong understanding of LLM inference mechanics (e.g. KV caching, continuous batching, memory management, model quantisation). Experience interacting with, and upstreaming code to, active open-source communities. Hands-on experience working on performance optimisation for hardware ...