16 of 16 Benchmarking Jobs in London

dashboard for accuracy and correct permissioning before it goes live, and help build repeatable checks the team can reuse for every future dashboard. Evaluation & Benchmarking – Help define evaluation criteria — accuracy, latency, cost, and user impact — to support decisions on what to scale. What You Need to Have: A degree ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

analytics platform brings together highly curated, enriched datasets; sophisticated analytical tools; streamlined workflows; and powerful visualisations. It enables essential IP activities including competitive intelligence, benchmarking and portfolio optimisationall in one place. As part of the AI Platform team, you will help research, design and deliver the AI capabilities behind these ...

integration. Deliver technical workshops, onboarding sessions, product demonstrations and technical guidance. Develop and maintain integration tools, scripts, utilities and example code. Support integration testing, benchmarking and system validation. Create and maintain technical documentation and integration guides. Work closely with Product and Engineering teams to escalate issues and provide actionable customer ...

Engineering Strong experience with LLMs, prompt engineering and model fine-tuning Experience building, testing or deploying agentic AI systems Knowledge of model evaluation, benchmarking and MLOps best practices Passion for emerging AI technologies and solving real-world problems Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts ...

/or external clients, and in preparing and conducting presentations to Senior Management. Technical Skills: Strong skills related to market sizing, competitive analysis, benchmarking, primary research, storytelling, and other relevant analytic frameworks. Communication Skills: Excellent written and verbal communication skills, with the ability to influence and engage stakeholders ...

front-end development tools such as Babel, Webpack, NPM, etc. Ability to understand business requirements and translate them into technical requirements A knack for benchmarking and optimization Familiarity with git Experience with React Native is a bonus ****THIS ROLE IS OFFICE BASED ...

simulation tooling High-performance market-data processing Linux, kernel and systems-level performance optimisation TCP/IP networking and kernel-bypass technologies Performance profiling, benchmarking and latency reduction Frameworks and tooling used across 100+ technology teams What were looking for Youll ideally come from a background in algorithmic trading, electronic ...

frameworks Strong, practical knowledge of agent evaluation (“evals”): task-success and trajectory testing, grounding and retrieval quality assessment, hallucination and drift detection, robustness testing, benchmarking, bias and fairness assessment, alignment and misalignment analysis, adversarial testing, and red-teaming Strong LLM/GenAI engineering fluency: prompting strategies, retrieval-augmented generation, context … identifying, assessing, and mitigating risks associated with GenAI and agentic AI Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad-hoc quantitative investigations Deliver validation outputs, from test plan design through clear, concise validation reporting and effective challenge of model developers Maintain clear ...

document root causes for the broader engineering team. Build internal tools and frameworks: Develop tools that improve operational efficiency, such as test suites, performance benchmarking frameworks, reproduction environments, diagnostic utilities, and internal dashboards that enable Ops and QA teams to resolve issues faster and validate fixes reliably. Mentor mid-level … etc.) and track record of identifying and fixing performance bottlenecks. Experience building test infrastructure: Previous work on test frameworks, load testing suites, or performance benchmarking systems. Capital markets knowledge: Familiarity with exchange technology, FIX protocols, market data formats, or trading workflows. Docker/containerization basics: Growing relevance for deployment ...

automations — to improve device stability and end-user experience. Troubleshoot and remediate audio, video, and conferencing reliability issues. Perform hardware and performance testing/benchmarking to support fleet standardization decisions. Autopilot & Provisioning Modernization Modernize Windows Autopilot and provisioning workflows to reduce legacy dependencies and improve consistency. Resolve drive-mapping dependencies … Dynamic Groups, and scalable targeting strategies Endpoint Analytics and digital experience monitoring (DEX) Hardware validation and lifecycle management, including: Hardware and performance testing/benchmarking to support fleet standardization decisions Firmware and BIOS update management and deployment (e.g., HP, Dell) Wi-Fi driver troubleshooting and remediation across the device fleet ...

Build, lead and develop a team of AI researchers and engineers. Lead hands-on development across LLMs, vision models and agentic systems. Own evaluation, benchmarking, model quality and continuous improvement. Partner with product, engineering and commercial teams to deliver research into production. The Person: 5+ years' applied AI research … research through to production. Hands-on expertise with LLM/vision model training, fine-tuning, agents and evaluation. Strong understanding of model quality, benchmarking and production ML systems. Excellent research judgement, ownership and communication skills. Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts an employment agency ...

agent capabilities, and work with the research engineers focused on improving the harness quality, to better align it with our customer needs via systematic benchmarking and hillclimbing on metrics that our customers care about. You will be responsible for driving the work that improves the quality of the fundamental technology … goals for the agent harness quality improvement workstream, then run its day to day execution, triage, stand-ups, status and escalation. Drive improvement through benchmarking and hillclimbing on metrics customers care about. Drive production readiness for each effort, load testing, capacity planning, quota, and the right deployment and sandbox environment ...

agent capabilities, and work with the research engineers focused on improving the harness quality, to better align it with our customer needs via systematic benchmarking and hillclimbing on metrics that our customers care about. You will be responsible for driving the work that improves the quality of the fundamental technology … goals for the agent harness quality improvement workstream, then run its day to day execution, triage, stand-ups, status and escalation. Drive improvement through benchmarking and hillclimbing on metrics customers care about. Drive production readiness for each effort, load testing, capacity planning, quota, and the right deployment and sandbox environment ...

scalable storage architectures including parallel file systems, object storage, and tiered storage Provide technical leadership and oversight to engineering and operations teams Lead performance benchmarking, capacity planning, and workload modelling activities Identify and resolve system bottlenecks to ensure optimal throughput and scalability Establish standards, reference architectures, and best practices across … systems Strong expertise across compute, storage, and high-performance networking Hands-on experience with HPC cluster environments and infrastructure components Experience with performance optimisation, benchmarking, and capacity planning Ability to provide technical leadership and define architectural standards Eligibility to obtain and maintain high-level security clearance This position offers ...