or create insights, that's a plus. Deeper systems knowledge. Extraexperience with any of the following would be an asset: developing GPU kernels and/or ML compilers (e.g. CUDA, OpenCL, TensorRT Plugins, MLIR, TVM, etc); optimizing systems to meet strict utilization and latency requirements with tools such as Nvidia NSight; and/or you've worked with embedded More ❯
scientists, and how to optimize the experience Core Technical skills : System administration experience with OS's like RHEL/CentOS, Ubuntu, tuning Linux kernel Proficiency with Ansible, Nvidia and CUDA toolkits, Kubernetes and container orchestration Understanding of automation, monitoring and security with GPU as a service Preferred experience Experience supporting HPE PCAI or other AI/HPC infrastructure and More ❯
scientists , and how to optimize the experience. Core Technical skills: System administration experience with OS's like RHEL/CentOS, Ubuntu, tuning Linux kernel Proficiency with Ansible, Nvidia and CUDA toolkits, Kubernetes, and container orchestration Understanding of automation, monitoring, and security with GPU as a service Preferred experience Experience supporting HPE PCAI or other AI/HPC infrastructure and More ❯
Inference experience for high-throughput model serving - Proven ability to work on air-gapped systems with no external package repositories - Experience with GPU orchestration (NVIDIA A100/H100) and CUDA optimisation - Python expertise with offline dependency management and local package mirrors Technical Stack (All On-Premises) Models: Llama 3, Mistral, Qwen (locally hosted) Vector Stores: Chroma, FAISS, Milvus Orchestration More ❯
proficiency in Nvidia GPU performance optimization techniques, including memory management, kernel fusion, and quantization strategies for large-scale deep learning workloads; - Strong foundation in parallel computing principles with practical CUDA programming experience, emphasizing efficient resource utilization and throughput maximization; - Demonstrated success implementing and tuning distributed AI systems leveraging modern frameworks like Megatron-LM and Ray, with particular focus on … Learning, Operations Research, Statistics, Mathematics, etc.); - Proficiency in performance optimization on Amazon Trainiums; - Proficiency in kernel programming for accelerated hardware using programming models such as (but not limited to) CUDA - Solid end-to-end hands-on development experience of deep learning algorithms related to Transformers; - Experience with patents or publications at top-tier peer-reviewed conferences or journals. - Past More ❯
