251 to 275 of 309 Benchmarking Jobs in London

Callosum Technologies Ltd. is hiring for a research-driven role in London to build and run a unified benchmarking system for evaluating agentic and algorithmic LLM workflows. You will design tasks, collect real commits/traces, and ensure robust, contamination-free evaluation with reproducible results. The role requires ...

Evident AI Index has rapidly become the global standard benchmark for AI maturity in banking.The Evident AI Index forms the basis of our benchmarking products, which help companies to understand their ranking in relation to peers and to accelerate their AI strategy. The Client Services team, sitting at the core … Evident’s value proposition to clients, is responsible for delivering bespoke benchmarking analysis to clients and shaping the strategy of our benchmarking products.**Why join us:**We are index experts. Our Co-Founders Alexandra Mousavizadeh and Annabel Ayles have more than 30 years of experience building complex indices that drive ...

client discovery workshops and stakeholder interviews; present and defend recommendations to senior client leadership; manage day-to-day client relationships and issue resolution. Drive benchmarking analysis and change-impact assessments grounded in deep knowledge of how your industry or function operates. Facilitate design thinking sessions and co-creation workshops with … process excellence, process redesign, or management consulting Demonstrated ability to lead client discovery workshops and present recommendations to senior leadership Proven track record building benchmarking analyses and change-impact assessments Experience using AI-assisted tools for benchmarking, analytics, or workshop facilitation Experience designing future-state processes with AI to reinvent ...

salary structures, pay ranges and market positioning, ensuring they remain scalable and relevant across geographies and talent segments. Lead annual and ad-hoc pay benchmarking using reputable market surveys, specialist technology data and peer comparisons. Lead the end-to-end annual pay review and bonus cycle, including budgets, modelling, governance … participant understanding. Annual pay and bonus reviews are delivered to timetable and budget, supported by high-quality data and decision-making. Pay structures and benchmarking improve market competitiveness, internal equity and critical-skill retention. Provider performance, costs and risks are actively managed through transparent service and commercial measures. Reward reporting ...

they remain robust, reliable and compliant with internal model risk standards. You will test model behaviour under extreme conditions, investigate unexpected outputs and develop benchmarking or challenger models. You will also conduct liquidity stress testing and assess the impact of new products, services, participants and currencies. The team is open … monitoring and governance activities. Test model assumptions, parameters, algorithms and outputs. Stress test models using extreme scenarios to identify weaknesses or unexpected behaviour. Develop benchmarking and challenger models. Maintain model documentation in line with model risk policy. Run daily and quarterly liquidity stress tests, including scenarios where participants fail ...

team on our regulated entities, prepare and produce annual FCA Remuneration data submissions for companies in Singapore, UK, Dubai and Geneva. Introduce a salary benchmarking tool (WTW) and upload up-to-date annual salary data. Develop high-quality HCM and market trend analysis to support HR and business leaders. Analyse … reports for committees, boards and other relevant groups. Support in operational areas of compensation including, but not limited to, offer consultation, market data, benchmarking, reporting, reconciliation, and other compensation analytics. Maintain records of all employee shareholding, including LTIP awards, SAYE scheme and ordinary shares to identify monthly share activities ...

Job Description Join a pioneering team at the forefront of systematic trading innovation. The Quantitative Trading & Research (QTR) group is responsible for systematic trading across FX, Rates, Commodities, Credit, Equity and a wide range of ...

About the job Help prove the ML software stack that future AI systems will depend on. the company is expanding the software systems behind AI compute at datacenter scale. This role focuses on validating a ...

Vantage Data Centers LLC is seeking a Senior Manager, Product Performance Benchmarking to establish a governable benchmarking capability at the heart of our global data center platform. You will define methodologies that connect capital cost, schedule, sustainability, and operational costs across regions and configurations. You will lead cross-functional collaboration ...

creation, including the creation of agents and other tools to help facilitate: Produce trend and forces assessments for your assigned industry or function, including benchmarking analyses that show where the client stands relative to peers and where the reinvention opportunity lies. Design future-state process specifications covering AI integration points … support delivery of digital and platform solutions across operations. Build analytical frameworks and data-driven assessments using AI-assisted visualization and analysis tools. Conduct benchmarking analysis with AI-accelerated industry and peer comparison tools. Develop change-impact assessments using AI-assisted organizational analysis tools. Apply your industry or function knowledge ...

client discovery workshops and stakeholder interviews; present and defend recommendations to senior client leadership; manage day-to-day client relationships and issue resolution. Drive benchmarking analysis and change-impact assessments grounded in deep knowledge of how your industry or function operates. Facilitate design thinking sessions and co-creation workshops with … process excellence, process redesign, or management consulting Demonstrated ability to lead client discovery workshops and present recommendations to senior leadership Proven track record building benchmarking analyses and change-impact assessments Experience using AI-assisted tools for benchmarking, analytics, or workshop facilitation Experience designing future-state processes with AI to reinvent ...

develop reference solutions. Your work will help shape the tooling and infrastructure that underpins our NLP capabilities. Key responsibilities of the role include: Profiling, benchmarking and optimising large-scale LLM inference workloads across our compute infrastructure Ensuring efficient deployment of the latest models across a range of GPU architectures, adapting … candidate will have the following skills and experience: A Bachelor’s, Master’s or PhD in computer science, or equivalent experience Proven experience profiling, benchmarking and optimising large-scale LLM inference workloads A scientific, evidence‐led approach to performance optimisation, using rigorous benchmarking and reproducible measurement Deep understanding of transformer ...

solving and communication skills Comfortable working autonomously. Technical Experience AI/LLM Evaluation, RAG Evaluation, Ragas, Agentic AI Evaluation, Evaluation Harnesses, LLM Testing and Benchmarking, Prompt Engineering, Python Development, Model and Agent Integration. Ideal Background AI Evaluation Engineer, Applied AI Engineer, AI Engineer, LLM Engineer, Harness Engineer, Prompt Engineer … engineering with strategic thinking, and thriving in fast-moving environments. Summary Hands-on AI Evaluation Engineer role supporting government AI initiatives through evaluation, testing, benchmarking and framework development. ...

procurement activities for TikTok’s Europe e-commerce local fulfillment logistics, including first-mile, line-haul, warehousing, and last-mile delivery, covering supplier selection, benchmarking, and commercial negotiation. Continuously optimize fulfillment cost and service quality by selecting high-performing logistics partners and improving pricing mechanisms, strengthening the platform’s overall … conduct regular evaluations to support supplier onboarding/offboarding decisions, ensuring compliance, risk control, and strong local logistics capability reserves. Conduct market analysis, competitor benchmarking, and pricing trend assessments to provide strategic insights and decision‐making support for procurement planning. Qualifications Minimum Qualifications Bachelor’s degree or above, preferably ...

agent capabilities, and work with the research engineers focused on improving the harness quality, to better align it with our customer needs via systematic benchmarking and hillclimbing on metrics that our customers care about. You will be responsible for driving the work that improves the quality of the fundamental technology … goals for the agent harness quality improvement workstream, then run its day to day execution, triage, stand-ups, status and escalation. Drive improvement through benchmarking and hillclimbing on metrics customers care about. Drive production readiness for each effort, load testing, capacity planning, quota, and the right deployment and sandbox environment ...

system behaviour, performance gaps, and real-world driving quality from a customer perspective. Key responsibilities: Plan and execute vehicle tests to support development, validation, benchmarking, and real-world deployment. Develop and improve vehicle validation test concepts to evaluate system performance across a range of real-world scenarios. Work closely with … support rapid iteration and decision-making. Provide detailed feedback on vehicle behaviour, driving performance, and system gaps from both technical and customer perspectives. Conduct benchmarking activities to evaluate system performance and track progress over time. Develop and improve testing processes, documentation, and operational best practices as the team scales. Manage ...

prototyping through production implementation and deployment on real-time vehicle platforms, including robust fault handling and degraded-mode behaviour. Develop rigorous validation and benchmarking capabilities, including representative datasets, ground-truth comparisons, performance metrics and regression testing across diverse vehicles, environments and operating conditions. Provide hands‐on technical leadership and mentorship … systems. Strong modern C++ software‐engineering skills and proficiency in Python for prototyping, analysis, validation and test tooling. Experience designing rigorous localisation validation and benchmarking, including accuracy metrics, uncertainty evaluation, ground‐truth comparison, regression testing and failure analysis. Evidence of hands‐on technical leadership, including defining architecture, influencing technical roadmaps ...

prototyping through production implementation and deployment on real-time vehicle platforms, including robust fault handling and degraded-mode behaviour. Develop rigorous validation and benchmarking capabilities, including representative datasets, ground-truth comparisons, performance metrics and regression testing across diverse vehicles, environments and operating conditions. Provide hands-on technical leadership and mentorship … systems. Strong modern C++ software-engineering skills and proficiency in Python for prototyping, analysis, validation and test tooling. Experience designing rigorous localisation validation and benchmarking, including accuracy metrics, uncertainty evaluation, ground-truth comparison, regression testing and failure analysis. Evidence of hands-on technical leadership, including defining architecture, influencing technical roadmaps ...

My client, a non-profit organisation specialising in Education and Culture are looking for a Data Analyst to join their team to help drive data-led decision making across a portfolio of digital learning and ...

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities ...

Business Intelligence Analyst required by our client an online international education provider, responsible for providing analysis and actionable insights to improve product performance, learner experience, and commercial outcomes. Reporting to the Head of Product, the ...

Data Analyst required by our client an online international education provider, responsible for providing analysis and actionable insights to improve product performance, learner experience, and commercial outcomes. Reporting to the Head of Product, the role ...

creation, including the creation of agents and other tools to help facilitate: Produce trend and forces assessments for your assigned industry or function, including benchmarking analyses that show where the client stands relative to peers and where the reinvention opportunity lies. Design future-state process specifications covering AI integration points … support delivery of digital and platform solutions across operations. Build analytical frameworks and data-driven assessments using AI-assisted visualization and analysis tools. Conduct benchmarking analysis with AI-accelerated industry and peer comparison tools. Develop change-impact assessments using AI-assisted organizational analysis tools. Apply your industry or function knowledge ...

based systems, from upstream training and reinforcement learning through fine-tuning, alignment, and deployment of globally scaled products Design and implement LLM evaluation and benchmarking frameworks to assess model quality, safety, bias, latency, and cost-efficiency Architect production inference infrastructure, including model optimisation, quantisation, and efficient serving strategies Drive model … powered products at scale Practical expertise in LLM fine-tuning, alignment, and customisation, including RLHF, LoRA, QLoRA, prompt optimisation, and LLM evaluation and benchmarking Strong software engineering proficiency in Python, Swift, and Java Experience building and operating enterprise-grade ML pipelines in cloud or on-prem environments Будет плюсом ...

compensation cycles (mid-year and annual), working within the Radford job architecture and salary ranges already in place Maintain and update salary benchmarking data (Radford Global Technology Survey), ensuring ranges remain competitive at the 50th percentile against PE-backed fintech peers Support the rollout of our Compensation Philosophy … years of experience in compensation and benefits, ideally in a multi‐country tech or fintech environment Hands‐on experience with Radford (or equivalent benchmarking methodology — Mercer, Willis Towers Watson) — you understand how to use survey data, not just read it Solid working knowledge of EU employment law, particularly ...