5 of 5 Permanent Low Latency Jobs in Scotland

advanced GitOps workflows Knowledge of identity platforms (ForgeRock, SAML) and modern auth protocols Ideal Candidate A hands-on engineer passionate about building high-scale, low-latency, resilient platform services , with strong problem-solving skills and a collaborative mindset. 📩 Apply now or reach out directly for a fast-track ...

workloads across CPU, GPU, and NPU clusters. Conduct in-depth profiling and performance tuning of inference pipelines, focusing on KV cache management. Develop low-latency, fault-tolerant AI serving frameworks using vLLM, Ray Serve, and PyTorch Distributed. Research and prototype novel techniques for cache sharing, data locality ...

using frameworks like vLLM, Ray Serve, and modern PyTorch Distributed systems. Scalable Model Serving Infrastructure: Develop and evaluate frameworks that enable efficient multi-tenant, low-latency, and fault-tolerant AI serving across distributed environments. Research and prototype new techniques for cache sharing, data locality, and resource orchestration ...

pipelines, specifically focusing on KV cache management and heterogeneous memory scheduling. AI Serving: Optimising high-throughput frameworks (vLLM, Ray Serve, PyTorch Distributed) to ensure low-latency, multi-tenant performance. Research Leadership: Contributing to top-tier venues (OSDI, NSDI, EuroSys, MLSys) and driving those innovations into real-world production. ...

models combining video, audio, image, and text signals Working with Multimodal Large Language Models (MLLMs), Vision Language Models (VLMs), and foundation models Develop scalable, low-latency AI systems suitable for high-concurrency production environments Collaborate with recommendation, search, and platform teams to integrate content intelligence signals into production ...