1 of 1 Permanent Ray Jobs in Cambridge

history of direct contributions to vLLM or similar high-performance open-source ML/AI projects (e.g. PyTorch, Hugging Face TGI, TensorRT-LLM, Ray). Strong understanding of LLM inference mechanics (e.g. KV caching, continuous batching, memory management, model quantisation). Experience interacting with, and upstreaming code to, active open ...