Senior Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- Hackajob Ltd
- Location
- Glasgow, Lanarkshire, Scotland, United Kingdom
- Employment Type
- Permanent
environments Operate and scale large language model serving infrastructure, including model hosting, request routing, continuous batching, and cache optimization Deploy, host, and lifecycle-manage open-source and proprietary large language models on cloud-based container orchestration platforms and on-premises GPU clusters using reproducible infrastructure as code … Amazon Bedrock for managed model hosting Experience with online large language model quality monitoring, including hallucination detection, toxicity filtering, and drift detection using open telemetry conventions Contributions to open-source large language model serving or inference projects, (vLLM, llm-d, Ray, KServe, Triton) ABOUT US Our client ...