Lead Software Engineer - LLM Ops Platform Reliability
- Location
- Paisley, Scotland, United Kingdom
JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online LLM quality monitoring (e.g., hallucination, toxicity, drift detection) and tracing via OpenTelemetry conventions Contributions to open-source LLM serving or inference projects (e.g., vLLM, llm-d, Ray, KServe, Triton) ABOUT US J.P. Morgan is a global leader ...