13 of 13 Amazon Bedrock Jobs in Glasgow

including model hosting, request routing, continuous batching, and KV-cache optimization Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on-prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement observability (logs … experience operating LLM inference servers such as vLLM and llm-d (or directly equivalent serving stacks) Hands-on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput trade ...

selecting the right model architectures to ensuring robust CI/CD and MLOps pipelines.Inference & Infrastructure: Deploy and optimise models using cloud services like AWS Bedrock and Azure AI Foundry, or self-host them on GPU/CPU hardware using tools like vLLM, SGLang, and Ollama.Solution Evaluation: Implement frameworks ...

integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacks Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online large language model quality monitoring, including hallucination detection, toxicity ...

operating or integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacksFamiliarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hostingExperience with online large language model quality monitoring, including hallucination detection, toxicity ...

practices.Preferred Qualifications, Capabilities, and SkillsExperience building agentic AI systems (multi-step workflows, tool routing, planning, memory patterns, supervision/fallback strategies).Experience with AWS Bedrock and/or SageMaker (or equivalent managed ML/GenAI platforms) and deployment patterns for scalable inference.Experience with evaluation frameworks and approaches (golden datasets ...

retrieval‐augmented generation (RAG) patterns Exposure to large language model serving, agentic patterns (tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAI Experience with Databricks, MongoDB, or large‐scale extract, transform, and load/data integration workflows Knowledge of data governance, lineage ...

retrieval-augmented generation (RAG) patternsExposure to large language model serving, agentic patterns (tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAIExperience with Databricks, MongoDB, or large-scale extract, transform, and load/data integration workflowsKnowledge of data governance, lineage, and entitlements concepts ...

open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with AI evaluation and observability practices: evals frameworks, red-teaming, prompt drift detection, and cost/latency monitoring for LLM workloads ...

open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with AI evaluation and observability practices: evals frameworks, red-teaming, prompt drift detection, and cost/latency monitoring for LLM workloadsUnderstanding ...

open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with emerging technologies in data engineeringAbility to drive innovation and continuous improvementPassion for mentoring and developing othersJ.P. Morgan is a global leader ...

open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering Ability to drive innovation and continuous improvement Passion for mentoring and developing others ABOUT ...

open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering Ability to drive innovation and continuous improvement Passion for mentoring and developing others Employer Description ...

open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with emerging technologies in data engineeringAbility to drive innovation and continuous improvementPassion for mentoring and developing othersEmployer DescriptionJPMorganChase, one of the oldest ...