1 to 25 of 82 Benchmarking Jobs in London

post‐transaction integration. Collaboration with internal stakeholders to maintain client relationships and develop new relationships to identify opportunities. Identification of industry trends, maintaining peer benchmarking and developments related to strategic advisory services by attending conferences, participating in training and conducting market research. Expectations To advise and influence decision‐making, contribute ...

Trading, QR peers, Technology, and Product to deliver measurable business impact. Design and enhance margin and derivative models, including methodology selection, calibration, numerical schemes, benchmarking/backtesting, documentation, and alignment with model risk governance. Serve as model owner: manage roadmaps, controls, monitoring/alerts, change management, and responses to Model ...

plans. Develop and maintain an External Monitoring System to compare external performance reporting with internal data, identifying and investigating variances. This will include analysing benchmarking data and performance trends against peer organisations. Represent the Trust through training programmes and presentations on data analytics, business intelligence, insights and performance management. Information ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

Face model hub). Experience sizing GPU infrastructure for LLM inference or training workloads (memory, throughput, hardware tiers from A10 to H200). Experience benchmarking and evaluating LLM performance (accuracy, latency, throughput). Hands‐on coding skills in Python, SQL, and familiarity with ML libraries and frameworks (PyTorch, TensorFlow, Hugging ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

Hands on end-to-end development and deployment of both traditional and GenAI-based machine learning models, including discovery analytics, experimental design, model development, benchmarking, enhancement and deployment. LLM & RAG Integration: Design and implement new Retrieval-Augmented Generation (RAG) pipelines and enhance existing frameworks, applying advanced techniques in data chunking ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

required — and ensure each AI feature addresses a genuine client need. Customer & Market Discovery Lead discovery into how clients use automotive data, including benchmarking, trend analysis, forecasting, compliance, and decision support, and translate these insights into product direction. Go‐to‐Market Coordinate with sales, marketing, and client success on positioning ...

robust and reusable q libraries, utilities, and frameworks with a strong focus on clean, maintainable, and performant code. Drive continuous improvement through refactoring, performance benchmarking, and adoption of best practices. Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality, and knowledge sharing. Participate ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

fleet of cutting‐edge AI systems. As part of our Software Platform organisation, you will be involved in the cloud integration, validation, performance benchmarking, optimisation, and development of our high‐performance AI solutions. These include in‐house AI systems alongside off‐the‐shelf high‐performance servers, switches and storage solutions. ...

technology roadmaps, business priorities and market developments. Optimise spend, simplify the supplier landscape and improve commercial outcomes across the technology estate. Use market intelligence, benchmarking and supplier insight to inform investment decisions and negotiation strategies. Strategic Sourcing Lead complex sourcing initiatives, contract negotiations and commercial discussions with leading technology vendors. ...

leverage at scale. Collaborate with procurement, technology and commercial teams to structure deals, optimize outcomes, and manage risk across the contract lifecycle (renewals, pricing, benchmarking, exit). Qualifications Experience : Senior technology lawyer (extensive PQE) with deep experience supporting software, SaaS or AI-enabled products within a product-led or technology ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

roadmap for AMZL, defining a 3–5-year strategy aligned with the broader portfolio Evaluate technology providers and platforms, conducting technical due diligence and benchmarking against operational requirements Author white papers and business cases for deployment initiatives, quantifying ROI, safety improvements, and associate experience impact Influence technical and business decisions ...

strategy, consumer insights, advertising effectiveness, or market research. Deep expertise in advertising research methodologies, including pre-market ad testing, creative diagnostics, campaign learning, norms, benchmarking, and KPI interpretation. Experience working with enterprise brands and senior stakeholders across Insights, Marketing, Brand, Media, Creative, Commercial, or Strategy teams. Strong understanding ...

other software teams) around shared interfaces and contracts. Raising the engineering bar broadly: establishing standards for testing (unit, integration, and on-hardware validation), performance benchmarking, operational excellence, and code quality, and holding the team to them through design and code review. Growing engineers: mentoring Junior and Mid level SDE, developing ...

development and governance Oversee the build, enhancement and implementation of liquidity stress models across asset classes and legal entities. Lead model validation, performance monitoring, benchmarking and back-testing activities. Team leadership and business partnership Lead and develop a global team of approximately seven specialists across London, New York and Mumbai. ...

performance Experience working with distributed systems, high-performance computing, or machine learning infrastructure Strong analytical skills and an interest in modelling complex systems Experience benchmarking and profiling large-scale workloads Understanding of parallel and distributed execution concepts Excellent programming skills in Python, C++ and/or Rust Comfortable working across ...

deliver measurable value. Evaluate AI models, platforms, frameworks and third-party tools based on capability, cost, latency, security and maintainability. Conduct model benchmarking, technical assessments and framework evaluations. Required Experience Proven experience designing, building and deploying Applied AI or Generative AI solutions. Strong hands-on experience with Large Language Models ...

iterate on algorithms and prompt engineering, specializing our LLMs for patent-specific tasks like claim analysis, prior art comparison, and obviousness assessments. Legal Benchmarking: Build proprietary datasets and evaluation frameworks to measure AI performance against real-world USPTO and international patent office requirements. Product Roadmap: Serve as the internal voice ...

platforms.* Implement prompt engineering strategies to improve response quality and accuracy.* Develop model guardrails, content filtering, and responsible AI controls.* Conduct AI model testing, benchmarking, and performance optimization.## **Your Skills:*** Strong programming skills in Python.* Experience with LLMs and Generative AI frameworks.* Hands-on experience with:* LangChain/LangGraph* Semantic ...

Feed-forward models Spatial foundation models Collaborate with research scientists and engineers to transition promising ideas into future products. Develop large-scale experiments and benchmarking frameworks. Work directly with the realities of production with real capture conditions, real hardware constraints, and real customers. Publish research findings at leading conferences such ...

ability to translate complex process and technology change into clear, actionable messaging for different audiences. A strong grounding in modern commercial KPIs and benchmarking, including pipeline efficiency, CAC payback, NRR, gross retention, magicnumberand forecast accuracy. Strong presentation and data-storytelling skills, with an instinct for the narratives leadership needs ...