Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- Hackajob Ltd
- Location
- Glasgow, Lanarkshire, Scotland, United Kingdom
- Employment Type
- Permanent
agents using frameworks such as LangChain, CrewAI, LangGraph, or similar orchestration platforms Experience operating or integrating serving platforms such as KServe, Ray Serve, NVIDIA Triton Inference Server, Text Generation Inference (TGI), alongside vLLM/llm-d Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting ...