Senior Software Engineer, Inference Platform
- Hiring Organisation
- Jobleads-UK
- Location
- Greater London, England, United Kingdom
scaling backend systems, distributed platforms, or inference infrastructure Strong understanding of AI/ML inference systems and experience with inference engines (vLLM, TGI, TensorRT‐LLM, or similar) Deep knowledge of distributed systems design, microservices architecture, and API gateway patterns Proficiency in Golang strongly preferred; Python, Rust, C++ for performance‐critical … processing frameworks Systems-Level Programming: Experience with low‐level systems programming such as storage systems, Kubernetes operators, OS-level software development, or daemon services (llm‐d, system agents) ML Platform Engineering: Experience productionizing ML pipelines, batch job orchestration, model fine‐tuning workflows, and Jupyter notebook orchestration systems Enterprise Deployment: Experience ...