1 to 25 of 286 Benchmarking Jobs in London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

across market risk and credit risk model families. Build and operate automated testing and validation frameworks for quantitative models, including test orchestration, result capture, benchmarking, and reporting. Develop data analysis and reconciliation tooling over large-scale risk datasets, ensuring data quality, lineage, and traceability across risk platforms. Contribute to model ...

complete set of world, regional and country markets. STOXX and DAX indices are licensed to more than 550 companies around the world for benchmarking purposes and as underlyings for ETFs, futures and options, structured products, and passively managed investment funds. STOXX Ltd., part of the ISS STOXX group of companies ...

business impacts tied to system changes or AI deployments, and proposing pragmatic mitigation strategies to leadership. Assess emerging technology and evolving business needs — benchmarking new IT and AI capabilities against current systems and industry standards to recommend enhancements, replatforming, or process redesign. Deliver sophisticated, data‐informed analysis — applying interpretive ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

degree (MS or PhD) in Computer Science, Software Engineering, or equivalent research/work experience Strong research background in empirical evaluation, experimental design, or benchmarking Deep familiarity with software engineering workflows and developer tools Experience working with or evaluating AI/ML models, preferably LLMs Strong analytical and communication skills ...

connected view of private capital activity. Built on granular data and robust methodologies, Company Intelligence supports scalable analysis across deal sourcing, due diligence, valuation benchmarking, and comparative research. By increasing transparency across the private company universe, it provides a connected view of company activity within the broader private capital ecosystem. ...

inputs for Inclusion/CSR/Environmental reports, human capital disclosures, regulatory or voluntary submissions, and stakeholder communications (e.g., annual Fitch BUILD report, Inclusion benchmarking). Coordinate with internal reviewers (Legal, Compliance, Internal Audit) and external partners to support assurance-readiness of metrics and narratives. Platform and partner management Serve ...

hedge funds. Its Company Intelligence platform delivers structured company, deal, ownership, fund, manager, and performance data to support investment analysis, due diligence, valuation benchmarking, and research. Задачи: Provide senior technical leadership and architectural direction for scalable data platforms and pipelines supporting Preqin's private company universe ...

ways of working. Highly autonomous and comfortable operating in ambiguity, with strong stakeholder management and communication skills. Experience conducting or supporting competitive analysis, market benchmarking, or industry research to inform product strategy and investment decisions. Why Join Us Foundational role: you will be the first Product Analyst in this part ...

techniques to analyze technology adoption patterns, performance benchmarks, and strategic opportunitiesDefine and monitor KPIs for technology strategy initiatives, innovation programs, and strategic investmentsCreate comprehensive benchmarking capabilities comparing Liberty Global's technology performance against industry leadersAI-Powered Technology Analysis & InnovationCollaborate with Technology and AI teams to develop proof of concepts using ...

skills, knowledge and experience. Plus London Weighting Allowance of £5,441 and 15% bonus OTE. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there ...

scalable, serving as the first-line technical lead during pilots and rollouts.* Document all builds, configurations, and prompts; design and run prompt evaluations, benchmarking, and accuracy/hallucination testing against gold-standard outputs; and define quantitative success criteria to ensure responsible AI use and data governance standards are met.* Develop ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad-hoc quantitative investigations. Own validation outputs end-to-end, from test plan design through clear, concise validation reporting and effective challenge of model ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad-hoc quantitative investigations. Own validation outputs end-to-end, from test plan design through clear, concise validation reporting and effective challenge of model ...

skills, knowledge and experience. Plus London Weighting Allowance of £5,441 and 15% bonus OTE. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application – though there ...

quantify transformation opportunities across Finance functions, developing transformation roadmaps and business cases with clear value realization targets. Lead finance diagnostic assessments, maturity reviews, benchmarking exercises, and transformation strategy engagements. Finance Process Transformation & Operational Excellence Lead end‐to‐end finance transformation initiatives across: Record-to-Report (R2R), Procure ...

skills, knowledge and experience. Plus London Weighting Allowance of £5,441 and 15% bonus OTE. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there ...

other as required)Databases: SQL Server, PostgreSQL, DynamoDB, possibly NoSQLCI/CD: GitLab, Jenkins, TerraformExperience we value: Financial and Capital marketsIndex and Benchmarking experience is a nice to have but no a strict requirementPragmatic application of technologies optimized for data distribution use casesBe able to be product centric and client ...

analyze technology adoption patterns, performance benchmarks, and strategic opportunities Define and monitor KPIs for technology strategy initiatives, innovation programs, and strategic investments Create comprehensive benchmarking capabilities comparing Liberty Global’s technology performance against industry leaders AI‐Powered Technology Analysis & Innovation Collaborate with Technology and AI teams to develop proof ...

hybrid deployment models. Understanding of LLM inference stacks (vLLM, llama.cpp, OpenVINO) and model delivery formats (ONNX, safetensors, HuggingFace model hub). Understanding of benchmarking and LLM performance evaluation (accuracy, latency, throughput). Hands-on coding skills in Python, and familiarity with ML libraries and frameworks (PyTorch, TensorFlow, Hugging Face). ...

Insights Hub, ECF2, IMR, IRIS, DOCOsoft and related systems) Deliver regulatory and market reporting including:Lloyd’s data calls and performance returns Market benchmarking and peer analysis Compliance and audit-related reporting outputs Partner with Compliance and QA functions in London and across the Enterprise to ensure adherence to regulatory ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

including Pandas, NumPy or similar libraries. Experience with ETL/ELT workflows, automated validation routines, controlled data refreshes, or data pipeline documentation. Exposure to benchmarking, normalization, regional factors, configuration bridges, confidence frameworks, or variance attribution. Experience working with Developers and IT to translate dataset requirements into tooling, automation, and reporting ...