Software Engineer III - AI/ML Platform
- Hiring Organisation
- Jobleads-UK
- Location
- Greater London, England, United Kingdom
practices. Preferred qualifications, capabilities, and skills Experience with performance profiling tools such as pprof, flamegraphs, or distributed tracing systems. Familiarity with containers and orchestration (Docker, Kubernetes) and service-to-service networking. Understanding of inference concepts: batching, streaming tokens, GPU memory constraints, KV cache. Experience with high-throughput APIs (gRPC/ ...