376 to 400 of 433 Benchmarking Jobs in the UK

ensuring they remain robust, reliable and compliant with internal model risk standards.You will test model behaviour under extreme conditions, investigate unexpected outputs and develop benchmarking or challenger models. You will also conduct liquidity stress testing and assess the impact of new products, services, participants and currencies.The team is open … quarterly model monitoring and governance activities.Test model assumptions, parameters, algorithms and outputs.Stress test models using extreme scenarios to identify weaknesses or unexpected behaviour.Develop benchmarking and challenger models.Maintain model documentation in line with model risk policy.Run daily and quarterly liquidity stress tests, including scenarios where participants fail to meet payment obligations.Analyse ...

JPMorganChase within the AI/ML Data Platform team, you will be a key technical contributor on LLM inference performance — supporting optimization strategy, benchmarking, and efficiency at scale. You will collaborate closely with senior engineers and engineering leadership to help shape how our platform evolves, ensuring every model we serve … high-impact individual contributor role where your technical contributions will have direct, measurable influence on the firm's AI capabilities.Job ResponsibilitiesExecute systematic benchmarking and performance characterization across production LLM workloads, establishing reproducible baselines, identifying regressions, and quantifying the impact of configuration changes before they reach productionDesign and run quantization experiments ...

Science & Exploratory Research team, combining hands‐on experimental research with technical leadership, project ownership and mentoring. Working across superconducting quantum circuits, processor characterisation, calibration, benchmarking and cryogenic measurement systems, you’ll investigate the limitations of existing technologies and explore new approaches to qubit design, packaging and quantum‐processing infrastructure. … equivalent professional experience. Experience owning research projects involving the measurement, characterisation or operation of quantum systems. Hands‐on experience running experimental quantum‐computing measurements, benchmarking processes or operational methods within an academic or industrial environment. Experience creating or running simulations of the quantum or radio‐frequency properties of superconducting circuits. ...

acquisition, extraction, normalisation, enrichment, quality control, delivery, and client integration. Partner with clients to understand their investment, due diligence, portfolio monitoring, valuation, risk, reporting, benchmarking, sustainability, and AI-driven workflow needs. Apply data-driven intelligence to measure product performance, identify coverage and quality gaps, uncover client insights, and guide roadmap … asset owners, allocators, consultants, fund administrators, and service providers. Understanding of private markets workflows, including due diligence, manager selection, portfolio monitoring, valuations, performance analysis, benchmarking, exposure analysis, capital flows, and reporting. Strong grasp of data science, AI, automation, and emerging agentic technologies, with the ability to translate these concepts into ...

sourcing, acquisition, extraction, normalisation, enrichment, quality control, delivery, and client integration.Partner with clients to understand their investment, due diligence, portfolio monitoring, valuation, risk, reporting, benchmarking, sustainability, and AI-driven workflow needs.Apply data-driven intelligence to measure product performance, identify coverage and quality gaps, uncover client insights, and guide roadmap decisions.Collaborate … asset owners, allocators, consultants, fund administrators, and service providers.Understanding of private markets workflows, including due diligence, manager selection, portfolio monitoring, valuations, performance analysis, benchmarking, exposure analysis, capital flows, and reporting.Strong grasp of data science, AI, automation, and emerging agentic technologies, with the ability to translate these concepts into practical financial ...

commercial models for thoseopportunities.Build Deal Materials: Create partner-facing decks, term sheets, and deal summaries forstrategic discussions with prospective and existing partners.Run Diligence & Benchmarking: Conduct commercial and financial diligence on prospectivepartners — reviewing financial statements, key performance metrics, product maturity, andbusiness models — to assess partner viability, the value of the capability … each partnerbrings, and whether the combined economics justify a partnership, and maintaincompetitive benchmarking of comparable partner and vendor terms in market so thatterms offered to Samba are tested against alternatives rather than accepted at face value.Negotiate & Coordinate: Support the negotiation of partnership terms across scope oflicence and intellectual property ...

with low latency, strong reliability, and efficient resource use. This role combines applied ML, inference optimization, evaluation, and production engineering, with a focus on benchmarking models, improving serving performance, validating quality, and building tooling that helps Cloudflare and its customers ship AI applications at Internet scale. Responsibilities Develop, optimize … productionize machine learning models for Cloudflare’s serverless inference platform, with a focus on performance, reliability, and model quality. Build benchmarking and evaluation frameworks to measure latency, throughput, cost efficiency, and model behavior across LLMs, speech, vision, and other model families. Improve inference performance through quantization, batching, caching, model compilation ...

Group is seeking a Head of Outcomes Analysis to lead the development of AI benchmarking frameworks in the financial sector. The role requires a strategic thinker with 10-12 years in analytics or research, capable of defining and evolving methodologies for AI adoption. The successful candidate will partner with product ...

engineering, orchestrate multiple models, and implement tool calling logic. System Observability : Use LangSmith or equivalent tracing/logging to monitor agent behaviour and performance. Benchmarking & Evaluation : Contribute to LLM benchmarking across tasks and model families. API Engineering : Build and consume REST APIs; integrate agentic workflows with Back End services. Architecture ...

performant, diagnosing issues associated with intense or unusual workloads. Automation : Automate the setup and configuration of storage infrastructure using tools such as Ansible. Performance Benchmarking : Lead storage benchmarking during procurement and track performance over the lifetime of the systems. Monitoring & Reporting : Maintain and update reporting interfaces to deliver accurate monitoring … knowledge You may have Solid experience in the provision of high performance, parallel file systems such Lustre, GPFS, Weka or others Experience with storage benchmarking tools for example ior, iozone, warp etc. Experience with cloud technologies, including Google or AWS certification Experience with various network technologies, such as Ethernet ...

solving and communication skills Comfortable working autonomously. Technical Experience AI/LLM Evaluation, RAG Evaluation, Ragas, Agentic AI Evaluation, Evaluation Harnesses, LLM Testing and Benchmarking, Prompt Engineering, Python Development, Model and Agent Integration. Ideal Background AI Evaluation Engineer, Applied AI Engineer, AI Engineer, LLM Engineer, Harness Engineer, Prompt Engineer … engineering with strategic thinking, and thriving in fast-moving environments. Summary Hands-on AI Evaluation Engineer role supporting government AI initiatives through evaluation, testing, benchmarking and framework development. ...

solving and communication skills Comfortable working autonomously. Technical Experience AI/LLM Evaluation, RAG Evaluation, Ragas, Agentic AI Evaluation, Evaluation Harnesses, LLM Testing and Benchmarking, Prompt Engineering, Python Development, Model and Agent Integration. Ideal Background AI Evaluation Engineer, Applied AI Engineer, AI Engineer, LLM Engineer, Harness Engineer, Prompt Engineer … engineering with strategic thinking, and thriving in fast-moving environments. Summary Hands-on AI Evaluation Engineer role supporting government AI initiatives through evaluation, testing, benchmarking and framework development. ...

Head of Outcomes Analysis, you will be the point person for delivering, scaling and evolving the methodology system behind Evident’s private benchmarking (‘Outcomes’) products. This is a senior, high-impact role where you will shape the way AI adoption, usage and business impact is measured across various financial services … gradually transitioning into a player-coach, building and mentoring a high-performing team of methodologists.## **Key Responsibilities*** Define, own and evolve the overarching AI benchmarking framework, to include taxonomy, maturity models, and scoring systems.* Deploy frameworks across sectors (banking, insurance, asset management) and functions (risk, operations, front office), ensuring these ...

visibility, efficiency, and effectiveness of hiring across the UK. In addition to developing internal data and reporting, you will provide external market intelligence, including benchmarking, competitor insights, and candidate pipeline analysis, ensuring Safran remains competitive in attracting critical talent. Looking after the people who make Safran great is our priority. … consistency *Provide regular and ad hoc reporting to support TA and HR leadership decision-making External Market Intelligence & Insights *Analyse and deliver salary benchmarking data to ensure Safran remains competitive across critical roles and markets *Provide competitor intelligence, including hiring trends, talent demand, and market activity within the aerospace, defence ...

JPMorganChase within the AI/ML Data Platform team, you will be a key technical contributor on LLM inference performance — supporting optimization strategy, benchmarking, and efficiency at scale. You will collaborate closely with senior engineers and engineering leadership to help shape how our platform evolves, ensuring every model we serve … high-impact individual contributor role where your technical contributions will have direct, measurable influence on the firm's AI capabilities. Job Responsibilities Execute systematic benchmarking and performance characterization across production LLM workloads, establishing reproducible baselines, identifying regressions, and quantifying the impact of configuration changes before they reach production Design ...

Technical leadership & architecture ownership Design and own end-to-end AI architectures that integrate: NLP pipelines LLM-based reasoning and orchestration Pipeline evaluations and benchmarking Knowledge graph grounding and validation Define how structured semantics constrain, validate, and guide generative outputs. Make pragmatic architectural decisions balancing accuracy, performance, explainability, and engineering … application layers. Maintain architectural coherence as features evolve and scale. Represent Applied AI in cross-functional technical discussions with Engineering and Product. Evaluation, benchmarking & quality Define and maintain evaluation frameworks for: Hallucination detection Precision and recall of extracted clinical concepts Regression testing across model updates Implement structured output approaches (e.g. ...

Time or Just-in-Time compilation flows for AI workloads Transforming graphs or working with operator partitioning, scheduling, memory planning, or model optimisation Validating, benchmarking, profiling, or analysing AI model performance Developing compiler technologies, intermediate representations, or hardware abstraction layers Building automated tests and CI/CD workflows for large … collaboratively across Arm provides exposure to inference engines and runtimes, accelerator integration, operator partitioning and fallback mechanisms, AOT and JIT compilation, model validation and benchmarking, performance optimisation, and automated validation workflows. There are also opportunities to build a broader understanding of how machine learning frameworks, software, compilers, and hardware come ...

Ahead-of-Time or Just-in-Time compilation flows for AI workloadsTransforming graphs or working with operator partitioning, scheduling, memory planning, or model optimisationValidating, benchmarking, profiling, or analysing AI model performanceDeveloping compiler technologies, intermediate representations, or hardware abstraction layersBuilding automated tests and CI/CD workflows for large-scale software … collaboratively across Arm provides exposure to inference engines and runtimes, accelerator integration, operator partitioning and fallback mechanisms, AOT and JIT compilation, model validation and benchmarking, performance optimisation, and automated validation workflows.There are also opportunities to build a broader understanding of how machine learning frameworks, software, compilers, and hardware come together ...

design and prototyping through production implementation and deployment on real-time vehicle platforms, including robust fault handling and degraded-mode behaviour.Develop rigorous validation and benchmarking capabilities, including representative datasets, ground-truth comparisons, performance metrics and regression testing across diverse vehicles, environments and operating conditions.Provide hands-on technical leadership and mentorship … real-time systems.Strong modern C++ software-engineering skills and proficiency in Python for prototyping, analysis, validation and test tooling.Experience designing rigorous localisation validation and benchmarking, including accuracy metrics, uncertainty evaluation, ground-truth comparison, regression testing and failure analysis.Evidence of hands-on technical leadership, including defining architecture, influencing technical roadmaps, mentoring ...

actionable analytics and reporting. In addition to FOS, Northern Trust leverages third-party analytical solutions for certain clients to enhance private markets performance measurement, benchmarking, and investment reporting.The candidate will be expected to develop proficiency in these tools and the associated data ecosystems that support them.Operating at the intersection … solutioning across different client segments. Leveraging expertise in private markets analytics concepts, DPI, TVPI etc and performance measurement including IRR vs TWR, PME’s, benchmarking, attribution, and accounting.Understanding the concepts for private market pacing and liquidity modelling and be able to talk to and demonstrate in system.Providing technical insight ...

actionable analytics and reporting. In addition to FOS, Northern Trust leverages third-party analytical solutions for certain clients to enhance private markets performance measurement, benchmarking, and investment reporting. The candidate will be expected to develop proficiency in these tools and the associated data ecosystems that support them. Operating … solutioning across different client segments. Leveraging expertise in private markets analytics concepts, DPI, TVPI etc and performance measurement including IRR vs TWR, PME’s, benchmarking, attribution, and accounting. Understanding the concepts for private market pacing and liquidity modelling and be able to talk to and demonstrate in system. Providing technical ...

platform standards, and explain advanced AI concepts in accessible terms.Identify high-impact opportunities where AI can deliver meaningful scientific value and define rigorous benchmarking and evaluation strategies to guide method selection.Develop, validate, and deploy robust image analysis algorithms to characterize cellular, organoid, tissue, and other complex biological phenotypes in high … image segmentation, feature extraction, phenotypic profiling, object classification, or representation learning applied to high-content or high-throughput imaging data.Practical expertise in designing benchmarking and evaluation strategies to compare image analysis methods and guide rigorous, evidence-based model selection.Ability to work effectively in Linux-based high-performance computing, cloud ...

Senior Machine Learning Engineer UK or Poland (Remote or Hybrid, it’s up to you!) Dependent on experience Be part of our success with the opportunity to join our company equity scheme Our Perks Monthly ...

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities ...

develop reference solutions. Your work will help shape the tooling and infrastructure that underpins our NLP capabilities.Key responsibilities of the role include:Profiling, benchmarking and optimising large-scale LLM inference workloads across our compute infrastructureEnsuring efficient deployment of the latest models across a range of GPU architectures, adapting the inference … ideal candidate will have the following skills and experience:A Bachelor’s, Master’s or PhD in computer science, or equivalent experienceProven experience profiling, benchmarking and optimising large-scale LLM inference workloadsA scientific, evidence-led approach to performance optimisation, using rigorous benchmarking and reproducible measurementDeep understanding of transformer inference, including ...