Software Engineer III - Data Analytics Platform
- Hiring Organisation
- Jobleads-UK
- Location
- Greater London, England, United Kingdom
provide an adventure where you can push the limits of what's possible. As a Software Engineer III at JPMorganChase within the Firmwide LLM Serving Platform team, you are an integral part of an agile team that designs, builds, and operates the services that make large language models usable … performance â pushing down latency, increasing throughput, maximizing GPU utilization, and eliminating waste across the request lifecycle. Job Responsibilities Build core backend services for LLM inference, including request routing, batching, scheduling, streaming responses, and quota/limits. Implement and maintain APIs and SDKs used by product and application teams across ...