Senior Software Engineer, Inference Platform
- Hiring Organisation
- Jobleads-UK
- Location
- Greater London, England, United Kingdom
after you’re helping with UI/UX, customer success, documentation and product ops. What You’ll Do Inference Platform Architecture & Core Services Design and build the company's inference service platform the backbone for serving AI models at scale across diverse workloads Own and architect core platform components … Gateway, Resource Orchestrator, Runtime Engines, and Autoscaler Design highly modular, scalable, and extensible low‐level designs (LLDs) for inference infrastructure components Lead high‐level design discussions, establish architectural patterns, and drive technical decision‐making for the inference stack Model Deployment & Lifecycle Management Understand and optimize the dynamics ...