Platform Engineer - Self Hosting LLMs London
- Location
- Greater London, England, United Kingdom
containers, Kubernetes, networking, storage and distributed-systems fundamentals. GPU observability and performance analysis across engine, system and accelerator metrics. Model formats, quantisation, tokenisation and OpenAI-compatible serving APIs. Traffic management, streaming, overload protection, health checking and failure recovery. Integration with existing identity, authorisation, secrets and workload-isolation systems. Clear technical ...