4 of 4 Amazon EKS Jobs in Lanarkshire

model hosting, request routing, continuous batching, and KV-cache optimization Deploy, host, and lifecycle-manage open-source and proprietary LLMs on Amazon EKS and Amazon SageMaker, as well as on-prem and local GPU clusters, using reproducible infrastructure as code and continuous delivery pipelines Implement … inference servers such as vLLM and llm-d (or directly equivalent serving stacks) Hands-on experience hosting and serving LLMs on Amazon EKS and/or Amazon SageMaker, and on local GPU infrastructure Knowledge of LLM reliability and risk considerations, including latency/throughput trade ...

automation and containerized application development. Deep AWS platform experience across compute, storage, networking, security, provisioning, and automation. Hands-on with services including EC2, ECS, EKS, ELB, S3, Lambda, API Gateway, Glue, EMR, ElastiCache, CloudWatch, and CodeDeploy. Infrastructure provisioning expertise using Terraform (advanced techniques), including implementing/configuring ...

driven architectures. Experience building and operating cloud-native services on AWS, including Bedrock. Strong DevOps practices: CI/CD pipelines, containerization (Docker, ECS/EKS), and infrastructure-as-code (e.g., Terraform/CloudFormation). Strong prompt engineering capability, including system prompts, few-shot prompting, tool/function calling ...

outputs, and adherence to resiliency and security expectations. Preferred qualifications, capabilities, and skills Experience with container and orchestration technologies such as AWS Lambda, Kubernetes (EKS), or AWS ECS ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most ...