1 to 25 of 151 Benchmarking Jobs in London

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

across market risk and credit risk model families. Build and operate automated testing and validation frameworks for quantitative models, including test orchestration, result capture, benchmarking, and reporting. Develop data analysis and reconciliation tooling over large-scale risk datasets, ensuring data quality, lineage, and traceability across risk platforms. Contribute to model ...

Identify and quantify transformation opportunities across Finance, developing transformation roadmaps and business cases with clear value-realisation targets. Lead finance diagnostic assessments, maturity reviews, benchmarking exercises and transformation strategy engagements. Finance Process Transformation & Operational Excellence Lead end-to-end transformation initiatives across areas including: Record-to-Report (R2R) Procure ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

effective, resilient, scalable and aligned with operational and business requirements. Data, Analytics and Decision Support Support the development and application of workplace analytics, utilisation benchmarking and performance reporting. This to be in tandem with Associate, Product Data Sustainability & Smart Workplace Present findings and recommendations to senior management, Executive Committee ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

into measurable business outcomes. Monitor and report on customer satisfaction indicators such as NPS, CSAT, and Customer Effort Score (CES), tracking performance trends and benchmarking against targets and industry standards. Collaborate with cross-functional teams to prioritise improvement initiatives, address root causes of customer dissatisfaction, and support the delivery ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you\u2019ll genuinely want to be part of. Interest ...

into measurable business outcomes. Monitor and report on customer satisfaction indicators such as NPS, CSAT, and Customer Effort Score (CES), tracking performance trends and benchmarking against targets and industry standards. Collaborate with cross-functional teams to prioritise improvement initiatives, address root causes of customer dissatisfaction, and support the delivery ...

partnership with Finance, support annual budgeting and monthly/quarterly business reviews Manage allocations and activity‐based costing, support cost‐to‐serve modeling and benchmarking to inform pricing and investment priorities Develop rigorous business cases and investment memos, including problem statements, options analysis, financial models, risks/assumptions and success ...

registries, Digital MRV for Carbon projects Reporting and disclosures including TCFD, SFDR, SASB, GRI, EU Taxonomy & CSRD ESG vendor selection assessments and vendor benchmarking Management of ESG technology strategy, design and implementation Your Key Responsibilities You will support delivery of ESG technology engagements on a standalone basis or as part ...

payroll inputs to ensure records remain accurate and current Support the Global Head of Reward with annual benefit renewals, provider reviews, new launches, market benchmarking and employee communications Manage pension administration processes, including UK compliance checks, contribution files and provider coordination Oversee US 401(k) contribution uploads and related checks ...

We are looking for a Director to join our team and take responsibility for the ongoing production and evolution of a new series of financial benchmarks. These benchmarks are currently focused on private company loans ...

programme, and operational levels covering resource management, supply chain performance, and commercial reporting Create insight-led dashboards including utilisation, allocation, gap analysis, KPI scorecards, benchmarking, and cost modelling to support decision-making Establish data governance standards, ensuring consistent structures, a single source of truth, and improved data accuracy through validation ...

generate measurable business value. Assess AI platforms, models and third-party technologies against criteria including performance, scalability, cost, latency, security and maintainability. Conduct model benchmarking, technical due diligence and framework evaluations to inform technology decisions. Skills & Experience Demonstrated experience designing, developing and deploying Applied AI and Generative AI solutions ...

Insights Hub, ECF2, IMR, IRIS, DOCOsoft and related systems) Deliver regulatory and market reporting including:Lloyd’s data calls and performance returns Market benchmarking and peer analysis Compliance and audit-related reporting outputs Partner with Compliance and QA functions in London and across the Enterprise to ensure adherence to regulatory ...

/CPU clusters across AWS, GCP, or Azure. Implement auto-scaling strategies, spot instance policies, and dynamic resource allocation to eliminate infrastructure waste. Establish benchmarking and telemetry to track unit economics and throughput for training and serving AI models. Implement end-to-end observability using tools like Prometheus, Grafana, OpenTelemetry ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you'll genuinely want to be part of. Interest ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

Drug Discovery teams make the best possible decisions to accelerate the delivery of new medicines. What you will do Conduct internal and external benchmarking on Machine Learning model performance and drug discovery processes. Collaborate with engineering to build an analytics layer that supports generalizable drug design and helps determine ...

come up with designs for AI/ML systems, pipelines and/or applications, and to implement them successfully.* Expertise in quantitative evaluation and benchmarking of state-of-the-art AI models.* Up to date knowledge of state of the art for ML Ops, ML infrastructure, including related tools, design ...