Software Engineer, Inference
- Location
- Greater London, England, United Kingdom
models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar. Experience with queues, scheduling, traffic control, and fleet management at scale. Experience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling. Familiarity with Redis and S3-compatible storage. Nice to Have Modern networking stacks including RDMA (RoCE ...