AI Infrastructure Engineer, Serving Platform
- Location
- Greater London, England, United Kingdom
skills in one or more languages (e.g., Python, Go, Rust, C++). Experience with LLM serving and routing fundamentals (e.g. rate limiting, token streaming, load balancing, budgets, etc.) Experience with LLM capabilities and concepts such as reasoning, tool calling, prompt templates, etc. Experience with containers and orchestration tools ...