Senior Software Engineer, Inference Platform
- Location
- Greater London, England, United Kingdom
Experience building high‐throughput, low‐latency systems with sub‐100ms response time requirements Familiarity with message queues (Kafka, RabbitMQ), databases (PostgreSQL, Redis), and event‐driven architectures Knowledge of GPU computing, model serving optimizations (batching, quantization, multi‐tenancy), and resource allocation Experience with observability tools (Prometheus, Grafana, OpenTelemetry ...