301 to 325 of 377 Benchmarking Jobs in the UK

meet agreed performance, reliability, and operational requirements. GPU Performance, Testing & Validation Define and execute infrastructure acceptance and validation plans for GPU clusters. Lead performance benchmarking using NCCL collectives and other GPU performance testing tools. Validate network fabrics, GPU interconnects, and cluster configurations to ensure optimal performance. Troubleshoot multi-node … network topology and GPU interconnect design impact distributed AI workload performance. GPU Performance & Validation Hands-on experience with NCCL and collective communication benchmarking, including nccl-tests. Familiarity with NVIDIA performance validation and diagnostic tooling, including Fabric Manager, DCGM, nvidia-smi, and nvbandwidthtest. Experience with InfiniBand and Ethernet fabric diagnostics, including ...

Lotus Cars builds world-class, high-performance and lightweight sports cars that are sold all around the world. To bring the company to the level we want it to be, we are looking for a ...

Placed at the heart of Gensler’s People + Process + Technology, the Global Design Technology Studio is advancing a growing data and machine learning foundation that is shaping how the firm designs and delivers ...

United Kingdom — International Student Market 654K inbound students (2024) +0% 1. India 169K 2. China 152K 4. United States 36K 5. Pakistan 31K 14 international branch campuses in United Kingdom Product Manager (Interviews & Interview Assessment ...

Senior Data Scientist I Senior Data Scientist I Excited to uncover insights from complex data and turn them into impactful business decisions? Do you enjoy building predictive models, experimenting with advanced analytics, and solving real ...

Callosum Technologies Ltd. is hiring for a research-driven role in London to build and run a unified benchmarking system for evaluating agentic and algorithmic LLM workflows. You will design tasks, collect real commits/traces, and ensure robust, contamination-free evaluation with reproducible results. The role requires ...

next generation Siri, we are developing novel measurements of its quality. To ensure that the evaluation systems we are building are reliable, we plan benchmarking their accuracy on a wide range of features, locales, and platforms using humans in the loop. Responsibilities Design and execute efficient data collection processes using ...

hand. That doesn’t scale, and it doesn’t hold up to outside scrutiny – from a customer, or from a reviewer. Callosum needs one benchmarking system: reproducible, contamination‐controlled, and trusted enough to be the evidence that decides which approach ships. This role owns that system. You will build ...

Evident AI Index has rapidly become the global standard benchmark for AI maturity in banking. The Evident AI Index forms the basis of our benchmarking products, which help companies to understand their ranking in relation to peers and to accelerate their AI strategy. The Client Delivery team, sitting … core of Evident’s value proposition to clients, is responsible for delivering bespoke benchmarking analysis to clients and shaping the strategy of our benchmarking products. We are index experts. Our Co-Founders Alexandra Mousavizadeh and Annabel Ayles have more than 30 years of experience building complex indices that drive positive ...

client discovery workshops and stakeholder interviews; present and defend recommendations to senior client leadership; manage day-to-day client relationships and issue resolution. Drive benchmarking analysis and change-impact assessments grounded in deep knowledge of how your industry or function operates. Facilitate design thinking sessions and co-creation workshops with … process excellence, process redesign, or management consulting Demonstrated ability to lead client discovery workshops and present recommendations to senior leadership Proven track record building benchmarking analyses and change-impact assessments Experience using AI-assisted tools for benchmarking, analytics, or workshop facilitation Experience designing future-state processes with AI to reinvent ...

autonomously detect environment drifts and analyse platform changes. GPU Platform & Low-Latency Network Validation: Automate the execution and results aggregation of cluster-level benchmarking suites and high-performance storage benchmarks to validate node-to-node throughput limits. Build validation routines to monitor high-throughput network fabrics, evaluating traffic patterns, congestion … understanding of high-throughput network fabrics, traffic patterns, and congestion control parameters in multi-node GPU clusters. Background in building and executing cluster-level benchmarking suites and high-performance storage benchmarks to isolate node-to-node throughput limits. Experience designing intelligent test systems capable of autonomously detecting environment drifts ...

independent technical advocate. HPC opportunities bring demands beyond a standard infrastructure engagement. These include data centre power and cooling, secure and sovereign research environments, benchmarking with real workloads, and constrained GPU supply. The Senior Solution Architect brings these together into commercially credible proposals, with lifecycle costs that include energy … regulated workloads, including Trusted Research Environments, data residency, and public sector and sovereign assurance requirements. Work with Security architects, who own the security controls. Benchmarking & Proofs of Value – Scope and run benchmarks, proofs of concept and vendor test drives using the customer's own workloads, with measurable success criteria ...

independent technical advocate. HPC opportunities bring demands beyond a standard infrastructure engagement. These include data centre power and cooling, secure and sovereign research environments, benchmarking with real workloads, and constrained GPU supply. The Senior Solution Architect brings these together into commercially credible proposals, with lifecycle costs that include energy … regulated workloads, including Trusted Research Environments, data residency, and public sector and sovereign assurance requirements. Work with Security architects, who own the security controls. Benchmarking & Proofs of Value – Scope and run benchmarks, proofs of concept and vendor test drives using the customer's own workloads, with measurable success criteria ...

Help define the evaluation strategy and methodology for AI capabilities across the company – automated metrics, human‐in‐the‐loop workflows, test set management, and benchmarking – and establish the quality standards other teams build against. Build evaluation frameworks and developer tooling robust enough for production yet simple enough for non‐specialist … such as COMET, chrF++, BLEU, MetricX, and MQM‐style human evaluation. Experience with experimentation and observability tooling, data/test‐set versioning, and rigorous benchmarking workflows. Established practice in AI governance and documentation - model cards, system cards, reproducibility, and responsible‐AI considerations - at an organizational level. Broad familiarity with ...

Help define the evaluation strategy and methodology for AI capabilities across the company - automated metrics, human-in-the-loop workflows, test set management, and benchmarking - and establish the quality standards other teams build against. Build evaluation frameworks and developer tooling robust enough for production yet simple enough for non-specialist … such as COMET, chrF++, BLEU, MetricX, and MQM-style human evaluation. Experience with experimentation and observability tooling, data/test-set versioning, and rigorous benchmarking workflows. Established practice in AI governance and documentation - model cards, system cards, reproducibility, and responsible-AI considerations - at an organizational level. Broad familiarity with ...

**Senior Data Scientist I****Excited to uncover insights from complex data and turn them into impactful business decisions?****Do you enjoy building predictive models, experimenting with advanced analytics, and solving real-world challenges with data ...

Data Scientist III Excited to uncover insights from complex data and turn them into impactful business decisions? Do you enjoy building predictive models, experimenting with advanced analytics, and solving real-world challenges with data? About ...

three days per week The Product Manager will act as product owner for the development of TCLP’s climate-aligned legal document creation and benchmarking product, building on our existing knowledge graph infrastructure. The role will lead the product across its lifecycle, from discovery and definition through development, launch, adoption … insight to identify and prioritise the problems the product should solve. Lead the definition and specification of the climate-aligned legal document creation and benchmarking product, translating evidence and specialist input into clear product requirements and priorities. Own and prioritise the product backlog, working with the Digital team to define ...

Build, lead and develop a team of AI researchers and engineers. Lead hands-on development across LLMs, vision models and agentic systems. Own evaluation, benchmarking, model quality and continuous improvement. Partner with product, engineering and commercial teams to deliver research into production. The Person: 5+ years' applied AI research … research through to production. Hands-on expertise with LLM/vision model training, fine-tuning, agents and evaluation. Strong understanding of model quality, benchmarking and production ML systems. Excellent research judgement, ownership and communication skills. Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts an employment agency ...

accurate physics models based on real hardware specifications Work with the hardware teams to implement new methods on our quantum devices Develop procedures for benchmarking quantum operations Analyse experimental results and compare them against theoretical predictions and models The 3 Most Critical Attributes We’ll Use to Compare Candidates: Experience … groups and/or the quantum hardware industry Must-have Skills (in addition to the above): Experience with circuit-level quantum noise models and benchmarking of quantum operations Proficient in writing scientific code, e.g. using Python PhD in quantum computing, quantum control or similar Excellent written and oral communication skills ...

Science & Exploratory Research team, combining hands‐on experimental research with technical leadership, project ownership and mentoring. Working across superconducting quantum circuits, processor characterisation, calibration, benchmarking and cryogenic measurement systems, you’ll investigate the limitations of existing technologies and explore new approaches to qubit design, packaging and quantum‐processing infrastructure. … equivalent professional experience. Experience owning research projects involving the measurement, characterisation or operation of quantum systems. Hands‐on experience running experimental quantum‐computing measurements, benchmarking processes or operational methods within an academic or industrial environment. Experience creating or running simulations of the quantum or radio‐frequency properties of superconducting circuits. ...

such as Vulkan, OpenCL, TOSA, or compute kernels Machine learning runtimes, compilers, drivers, or backend integration Computational graphs, operators, memory management, or model optimisation Benchmarking, profiling, testing, or analysing software performance Automated testing or CI/CD workflows AI-assisted development tools used responsibly to support software development, testing … alongside experienced engineers. You will gain exposure to machine learning inference engines and runtimes, compiler technologies, GPU and accelerator integration, model execution, performance optimisation, benchmarking, testing, and automated validation. As your experience develops, you will have opportunities to take on increasingly complex engineering challenges and build a broader understanding ...

Machine learning runtimes, compilers, drivers, or backend integration Computational graphs, operators, memory management, or model optimisation Ahead-of-Time or Just-in-Time compilation Benchmarking, profiling, testing, or analysing software performance Automated testing or CI/CD workflows AI-assisted development tools used responsibly to support software development, testing … alongside experienced engineers. You will gain exposure to machine learning inference engines and runtimes, compiler technologies, GPU and accelerator integration, model execution, performance optimisation, benchmarking, testing, and automated validation. As your experience develops, you will have opportunities to take on increasingly complex engineering challenges and build a broader understanding ...

real ownership from day one. This is not a role where you'll be handed a spec. What you’ll do - Own our AI benchmarking: help improve and design subject-specific evals that measure tutoring, marking, and content generation quality against what a good teacher would actually say - Improved … looking for - At least 2 years in a data science, ML, or applied research role, post-graduation - Hands-on experience evaluating or benchmarking AI/ML systems: you've built evals, designed metrics, or run structured model comparisons, and you can talk about where your own metrics misled you - Strong ...

Time or Just-in-Time compilation flows for AI workloads Transforming graphs or working with operator partitioning, scheduling, memory planning, or model optimisation Validating, benchmarking, profiling, or analysing AI model performance Developing compiler technologies, intermediate representations, or hardware abstraction layers Building automated tests and CI/CD workflows for large … collaboratively across Arm provides exposure to inference engines and runtimes, accelerator integration, operator partitioning and fallback mechanisms, AOT and JIT compilation, model validation and benchmarking, performance optimisation, and automated validation workflows. There are also opportunities to build a broader understanding of how machine learning frameworks, software, compilers, and hardware come ...