1 to 25 of 138 Benchmarking Jobs in London

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

Identify and quantify transformation opportunities across Finance, developing transformation roadmaps and business cases with clear value-realisation targets. Lead finance diagnostic assessments, maturity reviews, benchmarking exercises and transformation strategy engagements. Finance Process Transformation & Operational Excellence Lead end-to-end transformation initiatives across areas including: Record-to-Report (R2R) Procure ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

optimize IS spending while maintaining or improving service quality. Collaborate closely with Corporate IS Performance Management to accurately categorize IS costs and support benchmarking activities. Partner with local and global Finance teams to define, manage, and communicate Business Unit requirements related to IT cost allocation and chargeback models. Define, build ...

models through the full Software Development Life Cycle into production (including both ML and GenAI services).Perform exploratory data analysis, proof-of-concepts, model benchmarking, and validation experiments for both ML and GenAI approaches.Partnering with business leaders, domain experts, and end-users to gather requirements and align on success metrics.Follow ...

programme, and operational levels covering resource management, supply chain performance, and commercial reporting Create insight-led dashboards including utilisation, allocation, gap analysis, KPI scorecards, benchmarking, and cost modelling to support decision-making Establish data governance standards, ensuring consistent structures, a single source of truth, and improved data accuracy through validation ...

uses Morningstar's intellectual property to create indexes that empower investors to achieve their goals at every stage of the investment process - market monitoring, benchmarking, and asset allocation. The unit offers a broad suite of global equity, bond, private and asset allocation indexes. The Role As a part ...

needs and AIsolutions, and a quick understanding of commercial operations that happen inT&S Design and run evaluation and testing frameworks forGenAI systems, including benchmarking, reproducibility checks, and structuredmodel assessments Build solutions using Databricks infrastructure,Genie, MLflow (deployment and tracing and evaluations), LangChain, andLangGraph, and integrate them into scalable ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you\u2019ll genuinely want to be part of. Interest ...

registries, Digital MRV for Carbon projects Reporting and disclosures including TCFD, SFDR, SASB, GRI, EU Taxonomy & CSRD ESG vendor selection assessments and vendor benchmarking Management of ESG technology strategy, design and implementation Your Key Responsibilities You will support delivery of ESG technology engagements on a standalone basis or as part ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands‐on experience using enterprise-authorized AI‐assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

come up with designs for AI/ML systems, pipelines and/or applications, and to implement them successfully.* Expertise in quantitative evaluation and benchmarking of state-of-the-art AI models.* Up to date knowledge of state of the art for ML Ops, ML infrastructure, including related tools, design ...

generate measurable business value. Assess AI platforms, models and third-party technologies against criteria including performance, scalability, cost, latency, security and maintainability. Conduct model benchmarking, technical due diligence and framework evaluations to inform technology decisions. Skills & Experience Demonstrated experience designing, developing and deploying Applied AI and Generative AI solutions ...

required — and ensure each AI feature addresses a genuine client need. Customer & Market Discovery Lead discovery into how clients use automotive data, including benchmarking, trend analysis, forecasting, compliance, and decision support, and translate these insights into product direction. Go‐to‐Market Coordinate with sales, marketing, and client success on positioning ...

robust and reusable q libraries, utilities, and frameworks with a strong focus on clean, maintainable, and performant code. Drive continuous improvement through refactoring, performance benchmarking, and adoption of best practices. Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality, and knowledge sharing. Participate ...

cases. Deep understanding of cloud-native architecture and end-to-end ML workflows, including experimentation, feature management, model versioning, training, deployment, monitoring, performance benchmarking, and lifecycle management. Strong hands‐on experience with cloud platforms such as GCP or AWS, Kubernetes, distributed compute, CI/CD, observability, and infrastructure-as-code ...

large complex and/or global environment. Consistently demonstrates clear and concise written and verbal communication. Comprehensive knowledge of design metrics, analytics tools, benchmarking activities and related reporting to identify best practices. Demonstrated analytic/diagnostic skills. Ability to work in a matrix environment and partner with virtual teams. Ability ...

handover packs and assessment summaries for the Investment Determinations Team. Assess costs, benefits, and investment rationale while reviewing commercial assumptions and supporting evidence. Support benchmarking and comparative analysis activities and contribute to evidence-based decision support materials. Capture lessons learned from previous assessment rounds and help improve assessment frameworks, templates ...

historical workloads. Collaborate closely with Risk function teams to translate business requirements into efficient, scalable and performant code. Drive continuous improvement through refactoring, performance benchmarking and adoption of best practices. Mentor and guide junior and mid‐level developers, fostering a culture of technical excellence, code quality and knowledge sharing. Participate ...

robust and reusable q libraries, utilities, and frameworks with a strong focus on clean, maintainable, and performant code. Drive continuous improvement through refactoring, performance benchmarking, and adoption of best practices. Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality, and knowledge sharing. Participate ...

organisations. Experience operating within large global, matrixed and multicultural organisations. Familiarity with customer research, insight and analysis platforms. Familiarity with market research, customer insight, benchmarking and collaboration tools (e.g. PowerPoint, Excel, Figma, Qualtrics, Nielsen, GWI, Euromonitor) used to inform strategic decision-making and transformation programmes. About Us TCS Interactive ...

market levers by conducting deep, rigorous internal quantitative & qualitative analyses on our business and products Lead market research on industry trends, business models, competitor benchmarking, as well as ad products and emerging tech to generate new insights and develop growth strategies Deep dive into data and build analytics tools ...