Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- J.P. Morgan
- Location
- Glasgow, UK
- Employment Type
- Full-time
scale, with deep instrumentation and strong operational rigor. You will partner across engineering to deliver secure software, improve stability, and lead incident response and continuous improvement. \n Job Responsibilities \n \n Design, develop, troubleshoot, and deliver secure, high-quality production software and services for AI infrastructure \n Build backend … operation of AI infrastructure in production \n Operate and scale LLM serving infrastructure (such as vLLM and llm-d), including model hosting, request routing, continuous batching, and KV-cache optimization \n Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well ...