1 to 25 of 193 Benchmarking Jobs in London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

trends, patterns, risks and opportunities within complex datasets. Present clear, actionable insights to technical and nontechnical stakeholders, explaining the implications of the findings. Support benchmarking, A/B testing and experimentation. Contribute to improvements in data governance, quality assurance and reporting standards. Identify opportunities for reporting automation and process improvement.Work ...

recommendations from analysis. Present findings to technical and non-technical stakeholders. Help stakeholders understand the implications of data rather than simply reporting metrics. Support benchmarking and experimentation. Contribute to the evaluation of product releases and initiatives. Support improvements in data governance, quality assurance and reporting standards. Identify opportunities for reporting ...

Design – Work with the team to connect prototypes to enterprise data sources using modern tooling, with an emphasis on quality, reliability, and security. Evaluation & Benchmarking – Help define tests and evaluation criteria (accuracy, latency, cost, and user impact) to support decisions on what to scale. What You Need to Have ...

ways of working. Highly autonomous and comfortable operating in ambiguity, with strong stakeholder management and communication skills. Experience conducting or supporting competitive analysis, market benchmarking, or industry research to inform product strategy and investment decisions. Why Join Us Foundational role: you will be the first Product Analyst in this part ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential.- Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential.- Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Detailed responsibilities include:- Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance to identify knowledge ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance ...

external thought leadership through white papers, conference presentations, industry committees, and compelling narratives on measurement, ads efficacy, and Snap-specific analyticsLead meta-analyses, performance benchmarking, and playbook development to scale learnings and performance proof points across markets, verticals, and advertisersEstablish operational excellence for third-party measurement, including solution evaluation, adoption ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you'll genuinely want to be part of. Interest ...

written code for them.* Solid engineering discipline: automated testing, code review, CI/CD, observability, and infrastructure as code.* Comfortable with performance work - profiling, benchmarking, and reasoning about latency and throughput rather than guessing.## **Data and Infrastructure*** Proficiency with SQL and analytical or columnar stores* Experience with streaming and messaging ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

eg. CME, ICE, EEX, etc)* Implement customer facing features via SDKs and APIs* Improve observability in hot paths* Implement a new Automated Trading feature* Benchmarking code to reduce latency and improve throughput* Mentoring and coaching junior engineers* Design, plan and execute complex features and raise RFC’s **Our Tech Stack ...

dive investigations into complex production issues and performance anomalies, building custom diagnostic harnesses to pinpoint root causes. Tool & Framework Engineering: Develop internal tools, performance benchmarking frameworks, reproduction environments, and Real Time dashboards to optimize operational infrastructure. Cross-Functional Communication: Translate highly technical root-cause findings into clear summaries and diagrams ...

eg. CME, ICE, EEX, etc) Implement customer facing features via SDKs and APIs Improve observability in hot paths Implement a new Automated Trading feature Benchmarking code to reduce latency and improve throughput Mentoring and coaching junior engineers Design, plan and execute complex features and raise RFC's Our Tech Stack ...

related reporting for internal management and as input for external stakeholder communication. Project & Ad-hoc Support: Contribute to cross-functional FP&A initiatives (e.g., benchmarking, deep-dives, business cases, transformation projects) and provide analytical support for complex business questions. Knowledge & Attributes: Bachelor’s degree in business administration, finance, economics ...

/CPU clusters across AWS, GCP, or Azure. Implement auto-scaling strategies, spot instance policies, and dynamic resource allocation to eliminate infrastructure waste. Establish benchmarking and telemetry to track unit economics and throughput for training and serving AI models. Implement end-to-end observability using tools like Prometheus, Grafana, OpenTelemetry ...

mature, or significantly improve product analytics practices, including metrics frameworks, instrumentation, dashboards, governance, or ways of working. Experience conducting or supporting competitive analysis, market benchmarking, or industry research to inform product strategy and investment decisions. Foundational role: you will be the first Product Analyst in this part of the business ...

exchange agreements across both crypto and traditional marketsData Quality, Normalization & CoverageEnsure high-quality, normalized datasets across fragmented crypto venues (symbol mapping, schema standardization, latency benchmarking)Oversee ingestion of real-time order book data, trades, reference data, funding rates, and on-chain metricsEstablish monitoring and alerting frameworks for data integrity ...

testing) tailored to ultra-low-latency risk systems. Champion test-driven development (TDD) practices for mission-critical, heavily multi-threaded, asynchronous components. Establish performance benchmarking and latency regression testing — including messaging, network, CPU, and memory subsystem profiling — as part of the standard delivery pipeline. AI-Powered SDLC Leverage Citi ...

technology roadmaps, business priorities and market developments. Optimise spend, simplify the supplier landscape and improve commercial outcomes across the technology estate. Use market intelligence, benchmarking and supplier insight to inform investment decisions and negotiation strategies. Strategic Sourcing Lead complex sourcing initiatives, contract negotiations and commercial discussions with leading technology vendors. ...