Staff Software Engineer, Inference
- Hiring Organisation
- Humanloop
- Location
- London, UK
business leaders working together to build beneficial AI systems.About the roleOur Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry's largest compute-agnostic inference deployments. … systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.Key responsibilitiesDesign, build, and maintain the distributed systems that serve Claude to millions of users worldwideDevelop resilient, flexible systems that adapt in real time to real-world eventsDevelop intelligent request routing, load balancing, and traffic ...