1 to 25 of 305 Benchmarking Jobs in London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

trends, patterns, risks and opportunities within complex datasets. Present clear, actionable insights to technical and nontechnical stakeholders, explaining the implications of the findings. Support benchmarking, A/B testing and experimentation. Contribute to improvements in data governance, quality assurance and reporting standards. Identify opportunities for reporting automation and process improvement.Work ...

transformation environments. Technical capabilities A strong AISolutionArchitect should also have practical experience with: Foundation Models OpenAI Azure OpenAI Anthropic Google Gemini Model selection and benchmarking Prompt engineering Fine-tuning and model customisation where appropriate Agentic AI Multi-agent systems Tool calling Function orchestration Workflow automation Planning and reasoning patterns Human ...

data architectureGood understanding of DevOps practices including Git standards and CI/CD automationExperience working in Azure cloud environmentsFamiliarity with GenAI evaluation frameworks, benchmarking and testing methodologiesExcellent problem-solving, communication and stakeholder management skillsNice to haveUnderstanding of enterprise AI governance modelsHands-on experience with Microsoft Copilot, AI Foundry, Databricks MosaicAI ...

optimisation roadmap. Search intelligence, measurement and MarTech – Own the prompt universe: the strategic framework, alignment to Genpact's GTM priorities, buyer personas, competitive benchmarking, and prompt validation. Oversee the discoverability tech stack including BrightEdge, Adobe LLM Optimiser, Meltwater GenAI Lens, Jasper, and successor platforms. Own the roadmap, vendor management ...

into Genpact’s optimization roadmap.Search intelligence, measurement and MarTechOwn the prompt universe: the strategic framework, alignment to Genpact's GTM priorities, buyer personas, competitive benchmarking, and prompt validation.Oversee the discoverability tech stack including BrightEdge, Adobe LLM Optimizer, Meltwater GenAI Lens, Jasper, and successor platforms. Own the roadmap, vendor management ...

presentations as well as contributing to business plans, pitch preparation, competitive analysis, and client profiles.Deliver strategic intelligence to support lateral hiring decisions, including competitor benchmarking, practice-area mapping, and candidate-market analysis.Data, Technology & SystemsStay at the forefront of developments in business and competitive intelligence methodologies, including the application ...

recommendations from analysis. Present findings to technical and non-technical stakeholders. Help stakeholders understand the implications of data rather than simply reporting metrics. Support benchmarking and experimentation. Contribute to the evaluation of product releases and initiatives. Support improvements in data governance, quality assurance and reporting standards. Identify opportunities for reporting ...

Design – Work with the team to connect prototypes to enterprise data sources using modern tooling, with an emphasis on quality, reliability, and security. Evaluation & Benchmarking – Help define tests and evaluation criteria (accuracy, latency, cost, and user impact) to support decisions on what to scale. What You Need to Have ...

clinical stage, drug modality, and operational complexity. Data Integrity & Functional Trust: Build absolute trust and confidence with functional heads through transparent baseline metrics, standardized benchmarking, automated validation checks, and on-demand data access. Workforce Planning & Tool Deployment Named Allocation Leadership: Sponsor and roll out next-generation workforce management software, specifically ...

ways of working. Highly autonomous and comfortable operating in ambiguity, with strong stakeholder management and communication skills. Experience conducting or supporting competitive analysis, market benchmarking, or industry research to inform product strategy and investment decisions. Why Join Us Foundational role: you will be the first Product Analyst in this part ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential.- Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential.- Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Detailed responsibilities include:- Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance to identify knowledge ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

external thought leadership through white papers, conference presentations, industry committees, and compelling narratives on measurement, ads efficacy, and Snap-specific analyticsLead meta-analyses, performance benchmarking, and playbook development to scale learnings and performance proof points across markets, verticals, and advertisersEstablish operational excellence for third-party measurement, including solution evaluation, adoption ...

consumer-focused businesses. Knowledge of commercial optimisation techniques, including pricing, customer value, profitability and growth analytics. Experience using Bureau data, external market intelligence and benchmarking to identify commercial opportunities and market trends. Benefits package includes: Hybrid working - 40% office based Great compensation package and discretionary bonus plan Core benefits include ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you'll genuinely want to be part of. Interest ...

written code for them.* Solid engineering discipline: automated testing, code review, CI/CD, observability, and infrastructure as code.* Comfortable with performance work - profiling, benchmarking, and reasoning about latency and throughput rather than guessing.## **Data and Infrastructure*** Proficiency with SQL and analytical or columnar stores* Experience with streaming and messaging ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

eg. CME, ICE, EEX, etc)* Implement customer facing features via SDKs and APIs* Improve observability in hot paths* Implement a new Automated Trading feature* Benchmarking code to reduce latency and improve throughput* Mentoring and coaching junior engineers* Design, plan and execute complex features and raise RFC’s **Our Tech Stack ...

dive investigations into complex production issues and performance anomalies, building custom diagnostic harnesses to pinpoint root causes. Tool & Framework Engineering: Develop internal tools, performance benchmarking frameworks, reproduction environments, and Real Time dashboards to optimize operational infrastructure. Cross-Functional Communication: Translate highly technical root-cause findings into clear summaries and diagrams ...