AI Inference Engineer
- Hiring Organisation
- Fuse Energy Supply
- Location
- London, UK
- Employment Type
- Full-time
/CUDA performance layer and the inference serving layer at the same time, from scratch, and we're looking for the founding engineer to own the latter. Reporting directly to the CTO, you'll own the layer above kernels and hardware: how models actually get served, scaled … inference serving at the heart of our offering. ResponsibilitiesDefine Fuse's inference serving strategy and architecture from first principlesDesign and build the serving stack: request routing, batching, scheduling and autoscaling for high-throughput, latency-sensitive inference workloadsOwn model-level optimisation strategy for serving, deciding where ...