1 to 25 of 28 ONNX Jobs in the UK

including quantization, batching, caching, compilation, and serving runtime tuning. Experience with large‐scale inference serving frameworks or runtimes such as SGLang, vLLM, TensorRT-LLM, ONNX Runtime, Triton, llama.cpp, or similar. Familiarity with LLMs, speech models, vision models, embeddings, multimodal models, retrieval-augmented generation, or other modern deep learning architectures. Experience ...

following would be beneficial: LangChain and/or LangGraph Python memory management and performance optimisation GPU optimisation and acceleration PyTorch ONNX/ONNX Runtime Model inference and acceleration Responsibilities for Machine Learning Engineer: Develop and maintain high-quality Python software within advanced commercial AI products Deploy and integrate new machine …/Machine Learning Software Engineer/AI Integration Engineer/Python/Large Language Models/LLM/LangChain/LangGraph/PyTorch/ONNX/ONNX Runtime/NumPy/pandas/Machine Learning/Artificial Intelligence/GPU Optimisation/Model Inference/Model Acceleration/Deep Learning ...

world experience working with sensor data, time-series data, or IoT data streams Familiarity with embedded ML tools and approaches: TensorFlow Lite, Edge Impulse, ONNX Runtime, or equivalent Hands-on mindset; comfortable getting close to hardware, firmware code, and the real-world constraints of device deployment Clear communication; ability ...

world experience working with sensor data, time-series data, or IoT data streams Familiarity with embedded ML tools and approaches: TensorFlow Lite, Edge Impulse, ONNX Runtime, or equivalent Hands-on mindset; comfortable getting close to hardware, firmware code, and the real-world constraints of device deployment Clear communication; ability ...

building machine learning inference engines, runtime systems, or backend integration frameworks. Experience working with a machine learning inference framework such as LiteRT, TensorFlow Lite, ONNX Runtime, or a similar technology is also important. A good understanding of how AI models execute in practice is essential, including graph processing, operator execution ...

registry, versioning, CI/CD, drift detection, and retraining logic Working out how to run models in constrained or edge settings: quantisation, pruning, distillation, ONNX/TensorRT, and picking the right accelerators for the job Setting the evaluation approach - where precision and recall trade off, where thresholds ...

quality is non-negotiable. ML Stack Highlights Python and Rust. We keep things simple but use the right tool for the job Rust with ONNX in-process model execution where throughput is critical Chalk.ai as our Feature Store GCP Agent Platform Endpoints for model serving Cloud-native on GCP. Services ...

teams. Excellent communications skills both written and verbal “Nice To Have” Skills and Experience: Experience with AI/ML frameworks such as TensorFlow, PyTorch, ONNX, or inference runtimes. System bring-up and JTAG debugging expertise Good background of system performance analysis Experience with RTL simulation tools and software development tools ...

power/thermal, or cost). Strong proficiency with at least one relevant stack/toolchain (e.g. TensorRT, CUDA, Qualcomm QNN, Triton, OpenCL, MLIR, ONNX) and confidence learning adjacent frameworks quickly. Comfort operating at multiple levels of abstraction — from high-level model behaviour down to low-level kernel/runtime ...

evaluating ML models and/or privacy & security technologies for on-device performance. Experience with modern Machine Learning (ML) frameworks (e.g., Pytorch, TensorFlow, MLX, ONNX Runtime, Core ML, TensorRT, etc.). Skills That Will Set You Apart from the Competition Open source projects on mobile/desktop systems optimization Experience ...

demonstrate: Proven product management in development tools and software including CLIs, SDKs and APIs. Knowledge of machine learning frameworks, runtimes, infrastructure such as PyTorch, ONNX, ExecuTorch, Llama.cpp, vLLM and LiteRT. Understanding of model deployment to edge, embedded or heterogeneous computing, with an understanding of trade-offs between accuracy, performance ...

building machine learning inference engines, runtime systems, or backend integration frameworks. Experience working with a machine learning inference framework such as LiteRT, TensorFlow Lite, ONNX Runtime, or a similar technology is also important. A good understanding of how AI models execute in practice is essential, including graph processing, operator execution ...

exploration tooling to understand correlations, sparsity, and structure across sources Deploy models to production via the API and platform — including the gritty details when ONNX export or torch.compile breaks Iterate on model capabilities based on direct customer feedback Help shape the engineering and research culture as the team scales What ...

improvements Preferred: Experience with LLVM/MLIR development AI Model Profiling & Framework Optimization: Profile end-to-end inference workflows on frameworks like TensorFlow, PyTorch, ONNX, and llama.cpp to identify hotspots and bottlenecks Propose and implement optimization strategies (e.g., kernel tuning, graph-level optimizations) Preferred: Experience optimizing models on multiple ...

model inference performance on CPU and CPU/XPU hybrid systems, using advanced compiler techniques. You will profile frameworks such as TensorFlow, PyTorch and ONNX, optimize graph execution, and contribute to open research with practical insights and publications. #J-18808-Ljbffr ...

improvements Preferred: Experience with LLVM/MLIR development AI Model Profiling & Framework Optimization: Profile end-to-end inference workflows on frameworks like TensorFlow, PyTorch, ONNX, and llama.cpp to identify hotspots and bottlenecks Propose and implement optimization strategies (e.g., kernel tuning, graph-level optimizations) Preferred: Experience optimizing models on multiple ...

improvements Preferred: Experience with LLVM/MLIR development AI Model Profiling & Framework Optimization: Profile end-to-end inference workflows on frameworks like TensorFlow, PyTorch, ONNX, and llama.cpp to identify hotspots and bottlenecks Propose and implement optimization strategies (e.g., kernel tuning, graph-level optimizations) Preferred: Experience optimizing models on multiple ...

products, moving from prototypes to production devices deployed in customer fleets. The role combines kernel/driver work with edge AI deployment (TensorFlow Lite, ONNX Runtime) and requires mentoring peers, ensuring reliability, security, and field readiness. #J-18808-Ljbffr ...

across Rust, Python, and cloud environments. Join a quick-moving, growth-focused team focused on distributed systems, Kubernetes orchestration, and performance-tuned GPU inference (ONNX) in production, while shaping robust, scalable architecture and contributing to a culture of #J-18808-Ljbffr ...

model optimisation techniques such as quantisation, graph optimisation, operator fusionandprecision reduction Experience across multiple ML frameworks, model formats and inference runtimes, such as PyTorch, ONNX/ONNX Runtime, ExecuTorch, TensorFlow/LiteRT and OpenVINO. Experience analysing, profiling and debugging ML workloads, including model compatibility, performance and the trade-offs between ...

optimize open-source SLMs (e.g., Gemma 3, Llama 3) and vision-language models for execution on low-power edge runtimes (LiteRT/TensorFlow Lite, ONNX Runtime, ExecuTorch). Knowledge Analytics & Graph Processing: Design, implement, and maintain lightweight on-device graph databases and relationship extraction pipelines (Python, Rust, or C++ … V1.1/Dependable AI ). ML & Edge Inference Mastery 3+ years of production experience deploying ML models to edge runtime environments (LiteRT/TFLite, ONNX, C++ bindings). Experience in model quantization techniques (INT8, INT4, AWQ) and execution acceleration across NPU/GPU hardware. Proficiency in Python and PyTorch/ ...

optimize open-source SLMs (e.g., Gemma 3, Llama 3) and vision-language models for execution on low-power edge runtimes (LiteRT/TensorFlow Lite, ONNX Runtime, ExecuTorch). Knowledge Analytics & Graph Processing: Design, implement, and maintain lightweight on-device graph databases and relationship extraction pipelines (Python, Rust, or C++ … V1.1/Dependable AI ). ML & Edge Inference Mastery 3+ years of production experience deploying ML models to edge runtime environments (LiteRT/TFLite, ONNX, C++ bindings). Experience in model quantization techniques (INT8, INT4, AWQ) and execution acceleration across NPU/GPU hardware. Proficiency in Python and PyTorch/ ...

robust, scalable and reproducible training and inference workflows. What you will do Develop robust, scalable and reproducible inference pipelines. Deploy models into production using ONNX, TensorRT or similar frameworks. Build and optimise scalable machine learning training workflows. Optimise data loading, logging, checkpointing and resource utilisation for large-scale model training. … optimising and maintaining ML training and inference pipelines. Experience with Docker and containerised ML workflows. Experience with model deployment and optimisation frameworks such as ONNX, TensorRT or similar tools. Experience with GPU-based training, model serving and compute optimisation. Experience building and maintaining CI pipelines. Experience with cloud environments. Strong ...

robust, scalable and reproducible training and inference workflows. What you will do Develop robust, scalable and reproducible inference pipelines. Deploy models into production using ONNX, TensorRT or similar frameworks. Build and optimise scalable machine learning training workflows. Optimise data loading, logging, checkpointing and resource utilisation for large-scale model training. … optimising and maintaining ML training and inference pipelines. Experience with Docker and containerised ML workflows. Experience with model deployment and optimisation frameworks such as ONNX, TensorRT or similar tools. Experience with GPU-based training, model serving and compute optimisation. Experience building and maintaining CI pipelines. Experience with cloud environments. Strong ...

NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads ...