8 of 8 Amazon SageMaker Jobs in Scotland

including model hosting, request routing, continuous batching, and KV-cache optimization Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on-prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement observability … experience operating LLM inference servers such as vLLM and llm-d (or directly equivalent serving stacks) Hands-on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput ...

including model hosting, request routing, continuous batching, and KV‐cache optimization Deploy, host, and lifecycle‐manage open‐source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on‐prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement observability … experience operating LLM inference servers such as vLLM and llm‐d (or directly equivalent serving stacks) Hands‐on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput ...

integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacks Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online large language model quality monitoring, including hallucination detection ...

operating or integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacksFamiliarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hostingExperience with online large language model quality monitoring, including hallucination detection ...

integrating model serving platforms such as KServe, Ray Serve, or NVIDIA Triton Inference Server alongside other large language model serving stacks Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting Experience with online large language model quality monitoring, including hallucination detection ...

large language models and AI-assisted engineering tools, including their limitations, risks and operating considerations. Desirable experience includes AI platforms such as AWS SageMaker, MLOps and AI governance, platform engineering and developer portals, Kubernetes and related tooling, and work on public sector digital delivery or technology modernisation. Interested? Apply ...

client delivery experience and researchWe are looking for experience in the following skills and experience:AI/ML platform technologies and services such as Sagemaker/Vertex/Azure ML, OpenAI, Langchain, AutoML, OCR, STT, feature stores, vector DBAI/ML architectural patterns and best practices e.g. data drift ...

development programme that will allow you the freedom to take on training and certifications on the training platform of your choice. As an Amazon Web Services (AWS) cloud architect, you'll assist in implementing and supporting large-scale cloud implementations on Amazon AWS. Other duties include architecting … depth).Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components).Proven ability to take research and prototype environments to enterprise‐ready architectures, balancing speed, robustness ...