6 of 6 Remote/Hybrid vLLM Jobs in London

open inference. Knowledge of observability stacks, open Bonus Points Experience with AI and machine learning frameworks at scale (e.g., PyTorch, DeepSpeed, Megatron-LM, vLLM). Hands-on experience with major cloud platforms (e.g., AWS, GCP, Azure) and hybrid cloud architectures. Advanced experience with containerization (Docker) and orchestration (Kubernetes), including custom ...

these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, PalantirExperience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLMSearch and ranking experience. For example Elasticsearch or rerankersBackground in time series forecasting, causal inference, recommender systems or optimisationExperience managing cloud costs ...

. LLM observability and evaluation tools such as LangSmith, Langfuse, Arize or Weights & Biases. Experience hosting or serving open‐weight models (for example vLLM, Hugging Face, SageMaker). Awareness of AI governance and regulation, including the EU AI Act, ISO/IEC 42001 and GDPR. ITIL, Kubernetes (CKA/CKAD ...

experience with LLM training cycles, parameter-efficient fine-tuning (PEFT), and sophisticated prompt engineering. Inference Stack: Experience with high-performance inference servers (e.g., vLLM, TGI, or Triton ) and an understanding of how to optimize models for GPU deployment. Infrastructure: Comfortable working in Linux-based environments and proficient in managing containerized ...

FedRAMP Experience building developer tools, IDEs, code editors (e.g. Monaco, VS Code extensions) or code analysis tooling Experience serving custom or fine-tuned models (vLLM, TensorRT-LLM, Triton or similar) and GPU infrastructure Rust or C/C++ experience Experience selling to and deploying in regulated or security-conscious enterprises ...

Architectures: Hands-on experience building with OpenAI and Anthropic models/APIs; strong knowledge of LLMs and agent architectures. Tooling: Practical experience with LiteLLM, vLLM, Langfuse (or equivalent LLM observability tooling). Experience with Claude Code/Codex and associated coding-agent workflows is a plus. Evals: Proven ability ...