Senior Software Engineer, Inference Platform
- Hiring Organisation
- Jobleads-UK
- Location
- Greater London, England, United Kingdom
workloads Optimize inference pipelines for latency, throughput, batching efficiency, and resource utilization Design fault‐tolerant systems with graceful degradation and automatic recovery mechanisms Observability & Engineering Excellence Build high‐performance telemetry and observability stack for inference metrics, performance tracking, and debugging Implement comprehensive monitoring for model latency, throughput, error rates … RabbitMQ), databases (PostgreSQL, Redis), and event‐driven architectures Knowledge of GPU computing, model serving optimizations (batching, quantization, multi‐tenancy), and resource allocation Experience with observability tools (Prometheus, Grafana, OpenTelemetry) and distributed tracing Understanding of API design, rate limiting, authentication/authorization, and security best practices Exposure to AI model deployment ...