1 to 25 of 286 Benchmarking Jobs in London

secure, maintainable, and aligned with business objectives.Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment.Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment.Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value.Guide architectural decisions ...

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

Identify and quantify transformation opportunities across Finance, developing transformation roadmaps and business cases with clear value-realisation targets. Lead finance diagnostic assessments, maturity reviews, benchmarking exercises and transformation strategy engagements. Finance Process Transformation & Operational Excellence Lead end-to-end transformation initiatives across areas including: Record-to-Report (R2R) Procure ...

across market risk and credit risk model families. Build and operate automated testing and validation frameworks for quantitative models, including test orchestration, result capture, benchmarking, and reporting. Develop data analysis and reconciliation tooling over large-scale risk datasets, ensuring data quality, lineage, and traceability across risk platforms. Contribute to model ...

lifecycle across market risk and credit risk model families.Build and operate automated testing and validation frameworks for quantitative models, including test orchestration, result capture, benchmarking, and reporting.Develop data analysis and reconciliation tooling over large-scale risk datasets, ensuring data quality, lineage, and traceability across risk platforms.Contribute to model lifecycle management ...

complete set of world, regional and country markets. STOXX and DAX indices are licensed to more than 550 companies around the world for benchmarking purposes and as underlyings for ETFs, futures and options, structured products, and passively managed investment funds. STOXX Ltd., part of the ISS STOXX group of companies ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

Integration Design - Work with the team to connect prototypes to enterprise data sources using modern tooling, with an emphasis on quality, reliability, and security.Evaluation & Benchmarking - Help define tests and evaluation criteria (accuracy, latency, cost, and user impact) to support decisions on what to scale.What You Need to Have:A degree ...

define analytical objectives and scope, guiding them towards the most impactful solutions.Design and execute advanced custom analyses leveraging internal tools/databases (e.g., benchmarking, publisher optimization, program performance analysis), delivering comprehensive insights and strategic recommendations.Develop and optimize complex trend analyses and performance dashboards, ensuring they align with evolving client needs ...

effective, resilient, scalable and aligned with operational and business requirements. Data, Analytics and Decision Support Support the development and application of workplace analytics, utilisation benchmarking and performance reporting. This to be in tandem with Associate, Product Data Sustainability & Smart Workplace Present findings and recommendations to senior management, Executive Committee ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

degree (MS or PhD) in Computer Science, Software Engineering, or equivalent research/work experience Strong research background in empirical evaluation, experimental design, or benchmarking Deep familiarity with software engineering workflows and developer tools Experience working with or evaluating AI/ML models, preferably LLMs Strong analytical and communication skills ...

systems remain effective, resilient, scalable and aligned with operational and business requirements.Data, Analytics and Decision SupportSupport the development and application of workplace analytics, utilisation benchmarking and performance reporting. This to be in tandem with Associate, Product Data Sustainability & Smart WorkplacePresent findings and recommendations to senior management, Executive Committee and other ...

inputs for Inclusion/CSR/Environmental reports, human capital disclosures, regulatory or voluntary submissions, and stakeholder communications (e.g., annual Fitch BUILD report, Inclusion benchmarking).Coordinate with internal reviewers (Legal, Compliance, Internal Audit) and external partners to support assurance-readiness of metrics and narratives.Platform and partner managementServe ...

HuggingFace model hub). Experience sizing GPU infrastructure for LLM inference or training workloads (memory, throughput, hardware tiers from A10 to H200). Experience benchmarking and evaluating LLM performance (accuracy, latency, throughput). Hands-on coding skills in Python, SQL, and familiarity with ML libraries and frameworks (PyTorch, TensorFlow, Hugging ...

techniques to analyze technology adoption patterns, performance benchmarks, and strategic opportunitiesDefine and monitor KPIs for technology strategy initiatives, innovation programs, and strategic investmentsCreate comprehensive benchmarking capabilities comparing Liberty Global's technology performance against industry leadersAI-Powered Technology Analysis & InnovationCollaborate with Technology and AI teams to develop proof of concepts using ...

registries, Digital MRV for Carbon projects Reporting and disclosures including TCFD, SFDR, SASB, GRI, EU Taxonomy & CSRD ESG vendor selection assessments and vendor benchmarking Management of ESG technology strategy, design and implementation Your Key Responsibilities You will support delivery of ESG technology engagements on a standalone basis or as part ...

Hands on end-to-end development and deployment of both traditional and GenAI-based machine learning models, including discovery analytics, experimental design, model development, benchmarking, enhancement and deployment.LLM & RAG Integration: Design and implement new Retrieval-Augmented Generation (RAG) pipelines and enhance existing frameworks, applying advanced techniques in data chunking/ ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

into measurable business outcomes. Monitor and report on customer satisfaction indicators such as NPS, CSAT, and Customer Effort Score (CES), tracking performance trends and benchmarking against targets and industry standards. Collaborate with cross-functional teams to prioritise improvement initiatives, address root causes of customer dissatisfaction, and support the delivery ...

into measurable business outcomes. Monitor and report on customer satisfaction indicators such as NPS, CSAT, and Customer Effort Score (CES), tracking performance trends and benchmarking against targets and industry standards. Collaborate with cross-functional teams to prioritise improvement initiatives, address root causes of customer dissatisfaction, and support the delivery ...

partnership with Finance, support annual budgeting and monthly/quarterly business reviews Manage allocations and activity‐based costing, support cost‐to‐serve modeling and benchmarking to inform pricing and investment priorities Develop rigorous business cases and investment memos, including problem statements, options analysis, financial models, risks/assumptions and success ...

strategic business development opportunities.Support the valuation, positioning, and storytelling of media assets through audience analysis, consumer insights, and performance data.Conduct competitive analysis, industry benchmarking, and market research to identify trends and growth opportunities, developing data-driven materials that strengthen partner narratives and revenue initiatives.International Audience & Media Analytics:Lead international viewership ...