Sr. Software Engineer, Inference
- Location
- Greater London, England, United Kingdom
networked systems and performance optimisation. Hands-on experience with Kubernetes at production scale, including automated CI/CD and modern observability stacks (e.g., Prometheus, Grafana, OpenTelemetry). Practical, working knowledge of inference internals: batching strategies, caching, mixed precision (BF16/FP8), and streaming token delivery. Proven track record of improving ...