Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- Jobleads-UK
- Location
- Glasgow, Scotland, United Kingdom
agents using frameworks such as LangChain, CrewAI, LangGraph, or similar orchestration platforms Experience operating or integrating serving platforms such as KServe, Ray Serve, NVIDIA Triton Inference Server, Text Generation Inference (TGI), alongside vLLM/llm‐d Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting ...