1 to 25 of 301 Benchmarking Jobs in London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

secure, maintainable, and aligned with business objectives.Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment.Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment.Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value.Guide architectural decisions ...

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

across market risk and credit risk model families. Build and operate automated testing and validation frameworks for quantitative models, including test orchestration, result capture, benchmarking, and reporting. Develop data analysis and reconciliation tooling over large-scale risk datasets, ensuring data quality, lineage, and traceability across risk platforms. Contribute to model ...

lifecycle across market risk and credit risk model families.Build and operate automated testing and validation frameworks for quantitative models, including test orchestration, result capture, benchmarking, and reporting.Develop data analysis and reconciliation tooling over large-scale risk datasets, ensuring data quality, lineage, and traceability across risk platforms.Contribute to model lifecycle management ...

Identify and quantify transformation opportunities across Finance, developing transformation roadmaps and business cases with clear value-realisation targets. Lead finance diagnostic assessments, maturity reviews, benchmarking exercises and transformation strategy engagements. Finance Process Transformation & Operational Excellence Lead end-to-end transformation initiatives across areas including: Record-to-Report (R2R) Procure ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

complete set of world, regional and country markets. STOXX and DAX indices are licensed to more than 550 companies around the world for benchmarking purposes and as underlyings for ETFs, futures and options, structured products, and passively managed investment funds. STOXX Ltd., part of the ISS STOXX group of companies ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad‐hoc quantitative investigations. Own validation outputs end‐to‐end, from test plan design through clear, concise validation reporting and effective challenge of model ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

effective, resilient, scalable and aligned with operational and business requirements. Data, Analytics and Decision Support Support the development and application of workplace analytics, utilisation benchmarking and performance reporting. This to be in tandem with Associate, Product Data Sustainability & Smart Workplace Present findings and recommendations to senior management, Executive Committee ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

other as required)Databases: SQL Server, PostgreSQL, DynamoDB, possibly NoSQLCI/CD: GitLab, Jenkins, TerraformExperience we value:Financial and Capital marketsIndex and Benchmarking experience is a nice to have but no a strict requirementPragmatic application of technologies optimized for data distribution use casesBe able to be product centric and client ...

other as required)Databases: SQL Server, PostgreSQL, DynamoDB, possibly NoSQLCI/CD: GitLab, Jenkins, TerraformExperience we value: Financial and Capital marketsIndex and Benchmarking experience is a nice to have but no a strict requirementPragmatic application of technologies optimized for data distribution use casesBe able to be product centric and client ...

Integration Design - Work with the team to connect prototypes to enterprise data sources using modern tooling, with an emphasis on quality, reliability, and security.Evaluation & Benchmarking - Help define tests and evaluation criteria (accuracy, latency, cost, and user impact) to support decisions on what to scale.What You Need to Have:A degree ...

degree (MS or PhD) in Computer Science, Software Engineering, or equivalent research/work experience Strong research background in empirical evaluation, experimental design, or benchmarking Deep familiarity with software engineering workflows and developer tools Experience working with or evaluating AI/ML models, preferably LLMs Strong analytical and communication skills ...

define analytical objectives and scope, guiding them towards the most impactful solutions.Design and execute advanced custom analyses leveraging internal tools/databases (e.g., benchmarking, publisher optimization, program performance analysis), delivering comprehensive insights and strategic recommendations.Develop and optimize complex trend analyses and performance dashboards, ensuring they align with evolving client needs ...

systems remain effective, resilient, scalable and aligned with operational and business requirements.Data, Analytics and Decision SupportSupport the development and application of workplace analytics, utilisation benchmarking and performance reporting. This to be in tandem with Associate, Product Data Sustainability & Smart WorkplacePresent findings and recommendations to senior management, Executive Committee and other ...

HuggingFace model hub). Experience sizing GPU infrastructure for LLM inference or training workloads (memory, throughput, hardware tiers from A10 to H200). Experience benchmarking and evaluating LLM performance (accuracy, latency, throughput). Hands-on coding skills in Python, SQL, and familiarity with ML libraries and frameworks (PyTorch, TensorFlow, Hugging ...

techniques to analyze technology adoption patterns, performance benchmarks, and strategic opportunitiesDefine and monitor KPIs for technology strategy initiatives, innovation programs, and strategic investmentsCreate comprehensive benchmarking capabilities comparing Liberty Global's technology performance against industry leadersAI-Powered Technology Analysis & InnovationCollaborate with Technology and AI teams to develop proof of concepts using ...

registries, Digital MRV for Carbon projects Reporting and disclosures including TCFD, SFDR, SASB, GRI, EU Taxonomy & CSRD ESG vendor selection assessments and vendor benchmarking Management of ESG technology strategy, design and implementation Your Key Responsibilities You will support delivery of ESG technology engagements on a standalone basis or as part ...

Hands on end-to-end development and deployment of both traditional and GenAI-based machine learning models, including discovery analytics, experimental design, model development, benchmarking, enhancement and deployment.LLM & RAG Integration: Design and implement new Retrieval-Augmented Generation (RAG) pipelines and enhance existing frameworks, applying advanced techniques in data chunking/ ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

inputs for Inclusion/CSR/Environmental reports, human capital disclosures, regulatory or voluntary submissions, and stakeholder communications (e.g., annual Fitch BUILD report, Inclusion benchmarking).Coordinate with internal reviewers (Legal, Compliance, Internal Audit) and external partners to support assurance-readiness of metrics and narratives.Platform and partner managementServe ...

driving strong commercial outcomes while managing risk appropriatelyImprove value across the supplier base by supporting supplier consolidation, preferred supplier use, demand management, licence optimisation, benchmarking and cost reduction and strategic sourcingBuild trusted relationships with strategic suppliers and act as a senior commercial adviser to technology leaders, budget holders, Finance, Legal ...