2 of 2 vLLM Jobs in the UK

techniques (e.g., PEFT, LoRA, QLoRA) on open-source models (e.g., Llama, Mistral), alignment-tuning (e.g. DPO, ORPO). APIs: OpenAI, Anthropic, Gemini, etc. Inference: vLLM, llama.cpp, SGLang, etc. MLOps & Deployment Containerization: Docker Orchestration: Kubernetes (K8s) (for scalable inference) Cloud Platform: AWS, GCP, or Azure (experience with S3, EC2/ ...

scripting skills in Python or Bash Familiar with ML lifecycle tools, model monitoring, and versioning Exposure to tools like KServe, Ray Serve, Triton, or vLLM a big plus Bonus Points: Experience with observability frameworks like Prometheus or OpenTelemetry Knowledge of ML libraries: TensorFlow, PyTorch, HuggingFace Exposure to Azure ...