Staff Software Engineer, Inference
- Hiring Organisation
- Humanloop
- Location
- London, United Kingdom
- Salary
- > £ 150 K
caching strategiesDeep experience operating Kubernetes and cloud infrastructure at scaleExperience with AI accelerator platforms (GPUs, TPUs, or emerging hardware)Representative projectsDesigning intelligent routing algorithms that optimize request distribution across many accelerators in different environmentsAutoscaling our compute fleet to dynamically match supply with demand across production, research, and experimental workloadsBuilding production ...