Staff Machine Learning Engineer, LLM Inference Optimization
- Location
- Greater London, England, United Kingdom
hundreds of engineers with deep expertise across hardware, software and AI R&D. Role Summary Nebius Token Factory is building production-grade inference for open-source, customer, and internally optimized models. This role owns the path from model artifact to fast, reliable, cost-efficient endpoint. The work sits … outputs, streaming APIs, high concurrency, and multi-step orchestration. CUDA or Triton familiarity, even if the role is not primarily a kernel-engineering role. Open-source contributions to vLLM, SGLang, TensorRT-LLM, FlashInfer, LMCache, PyTorch, Triton, Ray, KServe, or related projects. Benefits & Perks: Competitive compensation Career growth ...