GPU Kernel and Performance Engineer
- Location
- Cambridge, England, United Kingdom
CUDA and Triton kernels on NVIDIA GPUs for sparse and structured model components, including block-sparse matrix operations and attention variants. Adapt and extend open-source kernels, such as FlashAttention-style and block-sparse attention, to new model designs. Profile training and inference to find where time … TPUs and dataflow, wafer-scale and compute-in-memory architectures, and port key components to them where it is useful. Contribute improvements back to open-source projects where possible. Proven experience writing and optimising GPU kernels in CUDA or Triton, ideally on recent NVIDIA architectures. A strong understanding ...