8 of 8 Amazon EKS Jobs in the Thames Valley

model hosting, request routing, continuous batching, and KV-cache optimization Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on-prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement … inference servers such as vLLM and llm-d (or directly equivalent serving stacks) Hands-on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput trade ...

Experience with Performance and Monitoring tools: JMeter, Kibana, Splunk, Dynatrace Experience writing Shell script Understanding of Python Good understanding on AWS services (EC2, ECS, EKS, API Gateway and Serverless technologies) Integration Engine tools: Apache Camel and Active MQ for messaging, web services and distributed systems Public Sector domain experience ...

automation and orchestration Build and deploy ML models for business use cases Work across AWS services including Bedrock, SageMaker, Lambda and ECS/EKS Lead AI innovation and enterprise transformation projects Collaborate cross-functionally and mentor other engineers What We're Looking For 7+ years' software engineering experience, with ...

container registries and supporting platform services. Maintain and improve on-premises infrastructure where required. Kubernetes & Platform Engineering Administer and optimise Kubernetes environments , including AWS EKS and OpenShift. Manage Helm-based application deployments and platform configuration. Support service-mesh technologies and distributed application architectures. Build robust container platforms using Docker … Control Tower . Strong experience with AWS security tooling, including GuardDuty, IAM Identity Center and CloudWatch . Significant experience administering Kubernetes , particularly EKS and/or OpenShift. Strong knowledge of Helm and Kubernetes application deployment. Experience building and administering on-premises Kubernetes environments . Experience with Nexus or comparable ...

AWS. Understanding of secure deployments, including air-gapped, on-premises or sovereign cloud environments. Strong technical ownership, documentation and stakeholder communication skills. Desirable Kubernetes, EKS or OpenShift. MLOps, monitoring, evaluation and reproducibility. Agent orchestration, A2A or MCP. Multimodal, edge or offline AI deployments. Secure-by-design principles, including ...

approaches: air-gapped, on-premises or sovereign cloud Nice to Have Multimodal reasoning and/or edge or offline AI deployment experience Kubernetes experience (EKS or OpenShift) MLOps background: evaluation, monitoring, reproducibility Observability for agentic systems, covering drift, agent behaviour and performance amiliarity with agent-to-agent orchestration protocols ...

approaches: air-gapped, on-premises or sovereign cloud Nice to Have Multimodal reasoning and/or edge or offline AI deployment experience Kubernetes experience (EKS or OpenShift) MLOps background: evaluation, monitoring, reproducibility Observability for agentic systems, covering drift, agent behaviour and performance amiliarity with agent-to-agent orchestration protocols ...

support a critical national law enforcement cloud program. In this role, you will lead the architecture, deployment, and optimization of highly secure, scalable Kubernetes (EKS), ECS, and Fargate environments. Working directly with lead architecture teams, you will ensure that cloud infrastructure aligns with stringent public sector security guidelines, NCSC … principles, and national security compliance frameworks. Key Responsibilities Secure Solution Architecture: Design and deploy high-availability, fault-tolerant containerized applications on AWS (EKS, ECS, Fargate) adhering to strict public sector security standards. Security and Compliance: Enforce public sector standards (NCSC Cloud Security Principles, ISO 27001, GDPR) through tight ...