4 of 4 Low Latency Jobs in Scotland

workloads across CPU, GPU, and NPU clusters. Conduct in-depth profiling and performance tuning of inference pipelines, focusing on KV cache management. Develop low-latency, fault-tolerant AI serving frameworks using vLLM, Ray Serve, and PyTorch Distributed. Research and prototype novel techniques for cache sharing, data locality ...

Europe. The Role Design, build and own end to end data pipelines supporting real time and batch analytics Work on high volume, low latency data use cases with a strong focus on reliability and scalability Develop production grade data solutions using software engineering best practices such ...

Europe. The Role Design, build and own end to end data pipelines supporting real time and batch analytics Work on high volume, low latency data use cases with a strong focus on reliability and scalability Develop production grade data solutions using software engineering best practices such ...

pipelines, specifically focusing on KV cache management and heterogeneous memory scheduling. AI Serving: Optimising high-throughput frameworks (vLLM, Ray Serve, PyTorch Distributed) to ensure low-latency, multi-tenant performance. Research Leadership: Contributing to top-tier venues (OSDI, NSDI, EuroSys, MLSys) and driving those innovations into real-world production. ...