2 of 2 Permanent Amazon SageMaker Jobs in Renfrewshire

including model hosting, request routing, continuous batching, and KV-cache optimization Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on-prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement observability … experience operating LLM inference servers such as vLLM and llm-d (or directly equivalent serving stacks) Hands-on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput ...

design and operate scalable AI infrastructure. You will own reliability, performance, and cost-efficiency of the LLM inference platform end-to-end, deploying on Amazon EKS, SageMaker, and on-prem GPU clusters with strong observability. You will lead incident response, capacity planning, and continuous improvement while collaborating across ...