Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- Jobleads-UK
- Location
- Glasgow, Scotland, United Kingdom
metrics, traces) with dashboards and actionable alerting, including Prometheus metrics and Grafana/Alertmanager integration for LLM and GPU workloads Tune GPU and accelerator capacity, autoscaling, and cost efficiency for LLM inference workloads using performance and optimization techniques (e.g., quantization, parallelism, speculative decoding) Lead reliability engineering for LLM endpoints … through capacity planning, load/soak testing, safe rollouts (blue/green, canary), failover, and incident response for outages and model‐quality regressions Participate in an on‐call rotation, lead incident triage and mitigation, and produce clear post‐incident root‐cause analyses and follow‐ups Identify recurring operational ...