2 of 2 Permanent Low Latency Jobs in Edinburgh

using frameworks like vLLM, Ray Serve, and modern PyTorch Distributed systems. Scalable Model Serving Infrastructure : Develop and evaluate frameworks that enable efficient multi-tenant, low-latency, and fault-tolerant AI serving across distributed environments. Research and prototype new techniques for cache sharing, data locality, and resource orchestration ...

inference pipelines Improve key-value cache efficiency and memory scheduling Identify bottlenecks and enhance system scalability using systematic performance analysis AI Serving Infrastructure Develop low-latency, multi-tenant, fault-tolerant model serving systems Work on areas such as cache sharing, data locality, and cluster scheduling Prototype and evaluate ...