4 of 4 Permanent Amazon Bedrock Jobs in Milton Keynes

including model hosting, request routing, continuous batching, and KV-cache optimization Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on-prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement observability (logs … experience operating LLM inference servers such as vLLM and llm-d (or directly equivalent serving stacks) Hands-on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput trade ...

open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with AI evaluation and observability practices: evals frameworks, red-teaming, prompt drift detection, and cost/latency monitoring for LLM workloads ...

open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering Ability to drive innovation and continuous improvement Passion for mentoring and developing others ABOUT ...

delivery quality, technical governance boards, and production readiness. Ecosystem Partnerships: Own technical relationships across major cloud AI ecosystems (Azure OpenAI, AWS Bedrock, Google Vertex AI, Anthropic, OpenAI). Reusable Assets: Drive the creation of reusable accelerators, frameworks, and IP across client engagements. Required Skills and Experience Clearance: Active … guardrails, and safe deployment at scale. Cloud and Model Ecosystems: Direct experience with major model providers (Anthropic, OpenAI, Google) and hyperscaler AI stacks (AWS Bedrock, Azure AI/OpenAI, Google Vertex AI). AI Governance: Deep knowledge of Responsible AI, risk management, and regulatory frameworks (e.g. ...