Staff Software Engineer, Inference
- Location
- Greater London, England, United Kingdom
speculative decoding and KV‐cache reuse—while establishing performance benchmarking frameworks, guiding cross‐functional alignment across infrastructure boundaries, and raising the bar for engineering rigour and observability practices across the organisation. Who You Are Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent … practical experience). 8+ years of experience building large‐scale distributed systems or cloud platforms, with a proven track record of leading cross‐team or organisation‐level technical initiatives at scale. Strong coding proficiency in Go, Python, or C++. Deep expertise in Kubernetes at production scale, including orchestration, scheduling ...