Lead Software Engineer - LLM Ops Platform Reliability
- Location
- Paisley, Scotland, United Kingdom
traces) with dashboards and actionable alerting, including Prometheus metrics and Grafana/Alertmanager integration for LLM and GPU workloads Tune GPU and accelerator capacity, autoscaling, and cost efficiency for LLM inference workloads using performance and optimization techniques (e.g., quantization, parallelism, speculative decoding) Lead reliability engineering for LLM endpoints through capacity ...