Lead Software Engineer - LLM Ops Platform Reliability
- Hiring Organisation
- Hackajob Ltd
- Location
- Paisley, Scotland, United Kingdom
/response logging, and safe rollout patterns Preferred Qualifications, Capabilities, and Skills Experience developing generative AI applications, AI agents, vector search, and retrieval-augmented generation patterns Experience building AI agents using frameworks such as LangChain, CrewAI, LangGraph, or similar orchestration platforms Experience operating … integrating serving platforms such as KServe, Ray Serve, NVIDIA Triton Inference Server, Text Generation Inference (TGI), alongside vLLM/llm-d Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online LLM quality monitoring (e.g., hallucination, toxicity, drift detection) and tracing ...