Staff Software Engineer, Inference
- Location
- Greater London, England, United Kingdom
Deep experience operating Kubernetes and cloud infrastructure at scale Experience with AI accelerator platforms (GPUs, TPUs, or emerging hardware) Representative projects Designing intelligent routing algorithms that optimize request distribution across many accelerators in different environments Autoscaling our compute fleet to dynamically match supply with demand across production, research, and experimental ...