1 to 25 of 116 Benchmarking Jobs in London

post‐transaction integration. Collaboration with internal stakeholders to maintain client relationships and develop new relationships to identify opportunities. Identification of industry trends, maintaining peer benchmarking and developments related to strategic advisory services by attending conferences, participating in training and conducting market research. Expectations To advise and influence decision‐making, contribute ...

with business objectives**.* Provide deep expertise in **model development, experimentation, optimization, evaluation, and production deployment**.* Establish standard methodologies for **LLM evaluation, model benchmarking, AI quality measurement, and performance assessment**.* Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. ...

Trading, QR peers, Technology, and Product to deliver measurable business impact. Design and enhance margin and derivative models, including methodology selection, calibration, numerical schemes, benchmarking/backtesting, documentation, and alignment with model risk governance. Serve as model owner: manage roadmaps, controls, monitoring/alerts, change management, and responses to Model ...

plans. Develop and maintain an External Monitoring System to compare external performance reporting with internal data, identifying and investigating variances. This will include analysing benchmarking data and performance trends against peer organisations. Represent the Trust through training programmes and presentations on data analytics, business intelligence, insights and performance management. Information ...

Assurance Defines and embeds appropriate testing and validation approaches for AI/ML solutions, including model evaluation and performance testing. Ensures that monitoring and benchmarking practices are in place so that models perform reliably and consistently in production. Supports the implementation of processes to identify and address model drift, data ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad‐hoc quantitative investigations. Own validation outputs end‐to‐end, from test plan design through clear, concise validation reporting and effective challenge of model ...

HuggingFace model hub). Experience sizing GPU infrastructure for LLM inference or training workloads (memory, throughput, hardware tiers from A10 to H200). Experience benchmarking and evaluating LLM performance (accuracy, latency, throughput). Hands‐on coding skills in Python, SQL, and familiarity with ML libraries and frameworks (PyTorch, TensorFlow, Hugging ...

graphs, test time compute, CoT pipelines, tool use & API calling, etc.) Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.) Evaluation (Benchmarking best practices, humans/LLMs as a judge, red teaming/adversarial testing, hallucination detection, etc.) As Manager of Research Engineering, you are both ...

Hands on end-to-end development and deployment of both traditional and GenAI-based machine learning models, including discovery analytics, experimental design, model development, benchmarking, enhancement and deployment. LLM & RAG Integration: Design and implement new Retrieval-Augmented Generation (RAG) pipelines and enhance existing frameworks, applying advanced techniques in data chunking ...

needs and AIsolutions, and a quick understanding of commercial operations that happen inT&S Design and run evaluation and testing frameworks forGenAI systems, including benchmarking, reproducibility checks, and structuredmodel assessments Build solutions using Databricks infrastructure,Genie, MLflow (deployment and tracing and evaluations), LangChain, andLangGraph, and integrate them into scalable ...

required - and ensure each AI feature addresses a genuine client need. Customer & Market Discovery - Lead discovery into how clients use automotive data, including benchmarking, trend analysis, forecasting, compliance, and decision support, and translate these insights into product direction. Go-to-Market - Coordinate with sales, marketing, and client success on positioning ...

robust and reusable q libraries, utilities, and frameworks with a strong focus on clean, maintainable, and performant code. Drive continuous improvement through refactoring, performance benchmarking, and adoption of best practices. Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality, and knowledge sharing. Participate ...

come up with designs for AI/ML systems, pipelines and/or applications, and to implement them successfully.* Expertise in quantitative evaluation and benchmarking of state-of-the-art AI models.* Up to date knowledge of state of the art for ML Ops, ML infrastructure, including related tools, design ...

historical workloads. Collaborate closely with Risk function teams to translate business requirements into efficient, scalable and performant code. Drive continuous improvement through refactoring, performance benchmarking and adoption of best practices. Mentor and guide junior and mid‐level developers, fostering a culture of technical excellence, code quality and knowledge sharing. Participate ...

robust and reusable q libraries, utilities, and frameworks with a strong focus on clean, maintainable, and performant code. Drive continuous improvement through refactoring, performance benchmarking, and adoption of best practices. Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality, and knowledge sharing. Participate ...

programme, and operational levels covering resource management, supply chain performance, and commercial reporting Create insight-led dashboards including utilisation, allocation, gap analysis, KPI scorecards, benchmarking, and cost modelling to support decision-making Establish data governance standards, ensuring consistent structures, a single source of truth, and improved data accuracy through validation ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you\u2019ll genuinely want to be part of. Interest ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

generate measurable business value. Assess AI platforms, models and third-party technologies against criteria including performance, scalability, cost, latency, security and maintainability. Conduct model benchmarking, technical due diligence and framework evaluations to inform technology decisions. Skills & Experience Demonstrated experience designing, developing and deploying Applied AI and Generative AI solutions ...

fleet of cutting‐edge AI systems. As part of our Software Platform organisation, you will be involved in the cloud integration, validation, performance benchmarking, optimisation, and development of our high‐performance AI solutions. These include in‐house AI systems alongside off‐the‐shelf high‐performance servers, switches and storage solutions. ...

cases. Deep understanding of cloud-native architecture and end-to-end ML workflows, including experimentation, feature management, model versioning, training, deployment, monitoring, performance benchmarking, and lifecycle management. Strong hands‐on experience with cloud platforms such as GCP or AWS, Kubernetes, distributed compute, CI/CD, observability, and infrastructure-as-code ...

share so success is shared, meaningful recognition for great work, and benefits that look after you and your family, including private healthcare, competitive salary benchmarking, and a confidential employee assistance program covering counselling, mental health support, and financial wellbeing. A community you'll genuinely want to be part of. Interest ...

workloads and GPU-accelerated infrastructure at scale Experience with InfiniBand, RoCE, or other HPC‐grade networking fabrics in production environments Experience with HPC benchmarking, validation, or performance testing (e.g. linpac, fio, NCCL, ibdiagnet) Exposure to large‐scale multi‐site or global infrastructure deployments Preferred Qualifications Bachelor or Masters Level degree ...

ensure the upcoming new CRM adoption aligns with digital marketing objectives, leveraging first-party data for targeted retargeting. Firmwide reporting: analyse data regularly, produce benchmarking reports, and contribute analysis for our teams different regular reports for the firms Team Leaders, Equity Partners and the Executive Committee, focusing on objective alignment ...

technology roadmaps, business priorities and market developments. Optimise spend, simplify the supplier landscape and improve commercial outcomes across the technology estate. Use market intelligence, benchmarking and supplier insight to inform investment decisions and negotiation strategies. Strategic Sourcing Lead complex sourcing initiatives, contract negotiations and commercial discussions with leading technology vendors. ...