21 of 21 Benchmarking Jobs in London

detection signals and continuously evolve them as threat actors change their tactics Measure detection performance through coverage, precision, false-positive rates and baseline benchmarking Quantify the scale and commercial impact of content scraping and content leakage to support prioritisation and investment decisions Investigate incidents and anomalous traffic patterns, distinguishing legitimate ...

dashboard for accuracy and correct permissioning before it goes live, and help build repeatable checks the team can reuse for every future dashboard. Evaluation & Benchmarking – Help define evaluation criteria — accuracy, latency, cost, and user impact — to support decisions on what to scale. What You Need to Have: A degree ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

engineering standards (Azure DevOps primarily). Collaborate closely with platform leads, architects, and design teams to ensure reliable operationalisation of AI services. Support benchmarking, evaluation, and experiment tracking for LLM performance and cost. Contribute to RAG implementations and data access patterns supporting enterprise use cases. Help shape API standards, reusable ...

protocols Experience designing and evolving software libraries Experience applying various forms of testing to underpin software qualities, e.g., correctness and performance Experience in measuring, benchmarking and profiling components and systems Excellent communication skills, both written and verbal, with the ability to communicate technical concepts to non-technical stakeholders Strong analytical ...

analytics platform brings together highly curated, enriched datasets; sophisticated analytical tools; streamlined workflows; and powerful visualisations. It enables essential IP activities including competitive intelligence, benchmarking and portfolio optimisationall in one place. As part of the AI Platform team, you will help research, design and deliver the AI capabilities behind these ...

integration. Deliver technical workshops, onboarding sessions, product demonstrations and technical guidance. Develop and maintain integration tools, scripts, utilities and example code. Support integration testing, benchmarking and system validation. Create and maintain technical documentation and integration guides. Work closely with Product and Engineering teams to escalate issues and provide actionable customer ...

Engineering Strong experience with LLMs, prompt engineering and model fine-tuning Experience building, testing or deploying agentic AI systems Knowledge of model evaluation, benchmarking and MLOps best practices Passion for emerging AI technologies and solving real-world problems Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts ...

/or external clients, and in preparing and conducting presentations to Senior Management. Technical Skills: Strong skills related to market sizing, competitive analysis, benchmarking, primary research, storytelling, and other relevant analytic frameworks. Communication Skills: Excellent written and verbal communication skills, with the ability to influence and engage stakeholders ...

front-end development tools such as Babel, Webpack, NPM, etc. Ability to understand business requirements and translate them into technical requirements A knack for benchmarking and optimization Familiarity with git Experience with React Native is a bonus ****THIS ROLE IS OFFICE BASED ...

simulation tooling High-performance market-data processing Linux, kernel and systems-level performance optimisation TCP/IP networking and kernel-bypass technologies Performance profiling, benchmarking and latency reduction Frameworks and tooling used across 100+ technology teams What we're looking for You'll ideally come from a background in algorithmic ...

frameworks Strong, practical knowledge of agent evaluation (“evals”): task-success and trajectory testing, grounding and retrieval quality assessment, hallucination and drift detection, robustness testing, benchmarking, bias and fairness assessment, alignment and misalignment analysis, adversarial testing, and red-teaming Strong LLM/GenAI engineering fluency: prompting strategies, retrieval-augmented generation, context … identifying, assessing, and mitigating risks associated with GenAI and agentic AI Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad-hoc quantitative investigations Deliver validation outputs, from test plan design through clear, concise validation reporting and effective challenge of model developers Maintain clear ...

document root causes for the broader engineering team. Build internal tools and frameworks: Develop tools that improve operational efficiency, such as test suites, performance benchmarking frameworks, reproduction environments, diagnostic utilities, and internal dashboards that enable Ops and QA teams to resolve issues faster and validate fixes reliably. Mentor mid-level … etc.) and track record of identifying and fixing performance bottlenecks. Experience building test infrastructure: Previous work on test frameworks, load testing suites, or performance benchmarking systems. Capital markets knowledge: Familiarity with exchange technology, FIX protocols, market data formats, or trading workflows. Docker/containerization basics: Growing relevance for deployment ...

automations — to improve device stability and end-user experience. Troubleshoot and remediate audio, video, and conferencing reliability issues. Perform hardware and performance testing/benchmarking to support fleet standardization decisions. Autopilot & Provisioning Modernization Modernize Windows Autopilot and provisioning workflows to reduce legacy dependencies and improve consistency. Resolve drive-mapping dependencies … Dynamic Groups, and scalable targeting strategies Endpoint Analytics and digital experience monitoring (DEX) Hardware validation and lifecycle management, including: Hardware and performance testing/benchmarking to support fleet standardization decisions Firmware and BIOS update management and deployment (e.g., HP, Dell) Wi-Fi driver troubleshooting and remediation across the device fleet ...

Build, lead and develop a team of AI researchers and engineers. Lead hands-on development across LLMs, vision models and agentic systems. Own evaluation, benchmarking, model quality and continuous improvement. Partner with product, engineering and commercial teams to deliver research into production. The Person: 5+ years' applied AI research … research through to production. Hands-on expertise with LLM/vision model training, fine-tuning, agents and evaluation. Strong understanding of model quality, benchmarking and production ML systems. Excellent research judgement, ownership and communication skills. Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts an employment agency ...

Our client is a global legal and business information company. Data Scientist III Excited to uncover insights from complex data and turn them into impactful business decisions? Do you enjoy building predictive models, experimenting with ...

designing and evolving messaging protocols or software libraries. Experience using different forms of testing to support software quality, including correctness and performance. Experience measuring, benchmarking and profiling components or systems. Strong written and verbal communication skills. YOU WILL: Analyse, design, discuss and develop distributed systems built on replicated state machines. … Design and evolve messaging protocols and software libraries. Troubleshoot and debug Java applications and distributed systems. Drive improvements in correctness and performance through testing, benchmarking, measurement and profiling. Raise the quality of our work through code reviews, pairing and technical discussions. Contribute to product decisions, not just task execution. Keep ...

agent capabilities, and work with the research engineers focused on improving the harness quality, to better align it with our customer needs via systematic benchmarking and hillclimbing on metrics that our customers care about. You will be responsible for driving the work that improves the quality of the fundamental technology … goals for the agent harness quality improvement workstream, then run its day to day execution, triage, stand-ups, status and escalation. Drive improvement through benchmarking and hillclimbing on metrics customers care about. Drive production readiness for each effort, load testing, capacity planning, quota, and the right deployment and sandbox environment ...

protocols across the full delivery lifecycle. Someone with genuine experience building Matching Engines and Platform Exchange Systems. Driven by evidence-based engineering, automated testing, benchmarking, and profiling rather than guesswork. A clear, confident communicator who can work across domain boundaries in a collaborative Agile environment, rather than being siloed into … across the delivery lifecycle. Define order, session, instrument, and account models alongside exchange integration boundaries. Develop automated testing strategies and perform evidence-based performance benchmarking and profiling. Collaborate directly with client teams, SREs, QA, and leadership to ensure exchange readiness and durable production fixes. Engage with client engineering and business ...

scalable storage architectures including parallel file systems, object storage, and tiered storage Provide technical leadership and oversight to engineering and operations teams Lead performance benchmarking, capacity planning, and workload modelling activities Identify and resolve system bottlenecks to ensure optimal throughput and scalability Establish standards, reference architectures, and best practices across … systems Strong expertise across compute, storage, and high-performance networking Hands-on experience with HPC cluster environments and infrastructure components Experience with performance optimisation, benchmarking, and capacity planning Ability to provide technical leadership and define architectural standards Eligibility to obtain and maintain high-level security clearance This position offers ...