1 to 25 of 192 Benchmarking Jobs in London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

trends, patterns, risks and opportunities within complex datasets. Present clear, actionable insights to technical and nontechnical stakeholders, explaining the implications of the findings. Support benchmarking, A/B testing and experimentation. Contribute to improvements in data governance, quality assurance and reporting standards. Identify opportunities for reporting automation and process improvement.Work ...

into Genpact’s optimization roadmap.Search intelligence, measurement and MarTechOwn the prompt universe: the strategic framework, alignment to Genpact's GTM priorities, buyer personas, competitive benchmarking, and prompt validation.Oversee the discoverability tech stack including BrightEdge, Adobe LLM Optimizer, Meltwater GenAI Lens, Jasper, and successor platforms. Own the roadmap, vendor management ...

recommendations from analysis. Present findings to technical and non-technical stakeholders. Help stakeholders understand the implications of data rather than simply reporting metrics. Support benchmarking and experimentation. Contribute to the evaluation of product releases and initiatives. Support improvements in data governance, quality assurance and reporting standards. Identify opportunities for reporting ...

Design – Work with the team to connect prototypes to enterprise data sources using modern tooling, with an emphasis on quality, reliability, and security. Evaluation & Benchmarking – Help define tests and evaluation criteria (accuracy, latency, cost, and user impact) to support decisions on what to scale. What You Need to Have ...

ways of working. Highly autonomous and comfortable operating in ambiguity, with strong stakeholder management and communication skills. Experience conducting or supporting competitive analysis, market benchmarking, or industry research to inform product strategy and investment decisions. Why Join Us Foundational role: you will be the first Product Analyst in this part ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

. PROPOSED SALARY RANGE: £40,000 - £50,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application – though there ...

external thought leadership through white papers, conference presentations, industry committees, and compelling narratives on measurement, ads efficacy, and Snap-specific analyticsLead meta-analyses, performance benchmarking, and playbook development to scale learnings and performance proof points across markets, verticals, and advertisersEstablish operational excellence for third-party measurement, including solution evaluation, adoption ...

consumer-focused businesses. Knowledge of commercial optimisation techniques, including pricing, customer value, profitability and growth analytics. Experience using Bureau data, external market intelligence and benchmarking to identify commercial opportunities and market trends. Benefits package includes: Hybrid working - 40% office based Great compensation package and discretionary bonus plan Core benefits include ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you'll genuinely want to be part of. Interest ...

analytics roadmap. Partner with Strategy and AI teams to identify opportunities for automation and AI-enabled insights. Lead development of scalable reporting frameworks, dashboards, benchmarking products and measurement tools. Drive innovation across APVision and future analytical capabilities. Data Enablement & Industry Thought Leadership Increase data literacy across Account Management, Strategy ...

written code for them.* Solid engineering discipline: automated testing, code review, CI/CD, observability, and infrastructure as code.* Comfortable with performance work - profiling, benchmarking, and reasoning about latency and throughput rather than guessing.## **Data and Infrastructure*** Proficiency with SQL and analytical or columnar stores* Experience with streaming and messaging ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

related reporting for internal management and as input for external stakeholder communication. Project & Ad-hoc Support: Contribute to cross-functional FP&A initiatives (e.g., benchmarking, deep-dives, business cases, transformation projects) and provide analytical support for complex business questions. Knowledge & Attributes: Bachelor’s degree in business administration, finance, economics ...

/CPU clusters across AWS, GCP, or Azure. Implement auto-scaling strategies, spot instance policies, and dynamic resource allocation to eliminate infrastructure waste. Establish benchmarking and telemetry to track unit economics and throughput for training and serving AI models. Implement end-to-end observability using tools like Prometheus, Grafana, OpenTelemetry ...

required - and ensure each AI feature addresses a genuine client need.* Customer & Market Discovery - Lead discovery into how clients use automotive data, including benchmarking, trend analysis, forecasting, compliance, and decision support, and translate these insights into product direction.* Go-to-Market - Coordinate with sales, marketing, and client success on positioning ...

dashboard for accuracy and correct permissioning before it goes live, and help build repeatable checks the team can reuse for every future dashboard. Evaluation & Benchmarking – Help define evaluation criteria — accuracy, latency, cost, and user impact — to support decisions on what to scale. What You Need to Have: A degree ...

testing) tailored to ultra-low-latency risk systems. Champion test-driven development (TDD) practices for mission-critical, heavily multi-threaded, asynchronous components. Establish performance benchmarking and latency regression testing — including messaging, network, CPU, and memory subsystem profiling — as part of the standard delivery pipeline. AI-Powered SDLC Leverage Citi ...

technology roadmaps, business priorities and market developments. Optimise spend, simplify the supplier landscape and improve commercial outcomes across the technology estate. Use market intelligence, benchmarking and supplier insight to inform investment decisions and negotiation strategies. Strategic Sourcing Lead complex sourcing initiatives, contract negotiations and commercial discussions with leading technology vendors. ...

MLOps methodologies. Experience delivering end-to-end machine learning projects from concept through to production deployment. Strong understanding of AI evaluation frameworks, model testing, benchmarking, and performance measurement. Knowledge of responsible and ethical AI principles, including bias detection and risk mitigation. Excellent stakeholder management and communication skills, with the ability ...

historical workloads. Collaborate closely with Risk function teams to translate business requirements into efficient, scalable and performant code. Drive continuous improvement through refactoring, performance benchmarking and adoption of best practices. Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality and knowledge sharing. Participate ...

eg. CME, ICE, EEX, etc)* Implement customer facing features via SDKs and APIs* Improve observability in hot paths* Implement a new Automated Trading feature* Benchmarking code to reduce latency and improve throughput* Mentoring and coaching junior engineers* Design, plan and execute complex features and raise RFC’s **Our Tech Stack ...