1 to 25 of 243 Benchmarking Jobs in London

secure, maintainable, and aligned with business objectives.Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment.Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment.Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value.Guide architectural decisions ...

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

Trading, QR peers, Technology, and Product to deliver measurable business impact. Design and enhance margin and derivative models, including methodology selection, calibration, numerical schemes, benchmarking/backtesting, documentation, and alignment with model risk governance. Serve as model owner: manage roadmaps, controls, monitoring/alerts, change management, and responses to Model ...

Integration Design - Work with the team to connect prototypes to enterprise data sources using modern tooling, with an emphasis on quality, reliability, and security.Evaluation & Benchmarking - Help define tests and evaluation criteria (accuracy, latency, cost, and user impact) to support decisions on what to scale.What You Need to Have:A degree ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

techniques to analyze technology adoption patterns, performance benchmarks, and strategic opportunitiesDefine and monitor KPIs for technology strategy initiatives, innovation programs, and strategic investmentsCreate comprehensive benchmarking capabilities comparing Liberty Global's technology performance against industry leadersAI-Powered Technology Analysis & InnovationCollaborate with Technology and AI teams to develop proof of concepts using ...

complete set of world, regional and country markets. STOXX and DAX indices are licensed to more than 550 companies around the world for benchmarking purposes and as underlyings for ETFs, futures and options, structured products, and passively managed investment funds. STOXX Ltd., part of the ISS STOXX group of companies ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad‐hoc quantitative investigations. Own validation outputs end‐to‐end, from test plan design through clear, concise validation reporting and effective challenge of model ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

your career as a Quantitative Analyst with Euronext MTS!Key AccountabilitiesDevelop a swap pricer for the main currencies (initially EUR, USD, GBP) .Testing and benchmarking accuracy of the pricer versus existing solutions in the market.To check that the real-time production implementation by IT fits with the original design ...

volatility surface modelling, regression, clustering, optimisation, machine learning, or model performance monitoring.Experience building reproducible quantitative analysis in Python, including data cleaning, visualization, statistical testing, benchmarking, and automation.Experience using AI-assisted development, code review, document analysis, or research tools productively and responsibly.Knowledge of valuation adjustments, prudent valuation, fair value hierarchy, future ...

models through the full Software Development Life Cycle into production (including both ML and GenAI services).Perform exploratory data analysis, proof-of-concepts, model benchmarking, and validation experiments for both ML and GenAI approaches.Partnering with business leaders, domain experts, and end-users to gather requirements and align on success metrics.Follow ...

models through the full Software Development Life Cycle into production (including both ML and GenAI services).Perform exploratory data analysis, proof-of-concepts, model benchmarking, and validation experiments for both ML and GenAI approaches.Partnering with business leaders, domain experts, and end-users to gather requirements and align on success metrics.Follow ...

programme, and operational levels covering resource management, supply chain performance, and commercial reporting Create insight-led dashboards including utilisation, allocation, gap analysis, KPI scorecards, benchmarking, and cost modelling to support decision-making Establish data governance standards, ensuring consistent structures, a single source of truth, and improved data accuracy through validation ...

European Group.Collaborate with the Regional Catastrophe Risk Manager and Catastrophe Modelling teams to analyse exposure to various peril-region hazards, providing actionable insights and benchmarking against internal appetites and industry standards.Design, maintain, and enhance catastrophe risk disaster scenarios, ensuring alignment with evolving business needs and emerging risk landscapes.Develop and implement ...

uses Morningstar's intellectual property to create indexes that empower investors to achieve their goals at every stage of the investment process - market monitoring, benchmarking, and asset allocation. The unit offers a broad suite of global equity, bond, private and asset allocation indexes. The Role As a part ...

needs and AIsolutions, and a quick understanding of commercial operations that happen inT&S Design and run evaluation and testing frameworks forGenAI systems, including benchmarking, reproducibility checks, and structuredmodel assessments Build solutions using Databricks infrastructure,Genie, MLflow (deployment and tracing and evaluations), LangChain, andLangGraph, and integrate them into scalable ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you\u2019ll genuinely want to be part of. Interest ...

. PROPOSED SALARY RANGE: £40,000 - £50,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands‐on experience using enterprise-authorized AI‐assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

come up with designs for AI/ML systems, pipelines and/or applications, and to implement them successfully.* Expertise in quantitative evaluation and benchmarking of state-of-the-art AI models.* Up to date knowledge of state of the art for ML Ops, ML infrastructure, including related tools, design ...

monitoring performance across retail and real estate sub‐sectors to assess risk, resilience and growth opportunity.Owns the development and maintenance of a consistent market benchmarking methodology, leveraging datasets including Trevor Wood, transactional banking and demographic sources to compare asset and portfolio performance.Builds and sustains senior relationships with Heads of Research ...

stakeholder management and change management activity as well as strong governance and project management. The key phases of an advisory engagement usually include benchmarking existing capability, designing, and developing an enhanced capability, establishing or implementing that enhanced capability and supporting the client to adopt and embed ...