Senior Software Engineer, Inference Platform
- Hiring Organisation
- Jobleads-UK
- Location
- Greater London, England, United Kingdom
reliability. You’ve designed distributed systems that handle thousands of requests per second while maintaining sub‐second response times and cost efficiency. Experience with Golang is strongly preferred, and exposure to inference engines (vLLM, TGI, TensorRT), containerization, and distributed systems is an added bonus. You take ownership of platform‐level … experience with inference engines (vLLM, TGI, TensorRT‐LLM, or similar) Deep knowledge of distributed systems design, microservices architecture, and API gateway patterns Proficiency in Golang strongly preferred; Python, Rust, C++ for performance‐critical components a plus Experience with container orchestration (Kubernetes, Docker) and infrastructure‐as‐code Solid understanding of autoscaling ...