21 of 21 Benchmarking Jobs in London

Hybrid PROPOSED SALARY RANGE: £55,000 - £65,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there ...

workflows Working with AWS services including Bedrock, AgentCore, EKS, EC2, S3 and SQS Designing CI/CD pipelines, automation and reusable microservices Supporting LLM benchmarking, performance monitoring and cost optimisation Integrating AI services with enterprise security and observability frameworks Collaborating with architects and platform engineers on scalable AI solutions What ...

engineering standards (Azure DevOps primarily). Collaborate closely with platform leads, architects, and SRE teams to ensure reliable operationalisation of GenAI services. Support benchmarking, evaluation, and experiment tracking for LLM performance and cost. Contribute to RAG implementations and data access patterns supporting enterprise use cases. Help shape API standards, reusable ...

dashboard for accuracy and correct permissioning before it goes live, and help build repeatable checks the team can reuse for every future dashboard. Evaluation & Benchmarking – Help define evaluation criteria — accuracy, latency, cost, and user impact — to support decisions on what to scale. What You Need to Have: A degree ...

relevant skills, knowledge and experience. Plus London Weighting Allowance of £5,441. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there's no obligation ...

analytics platform brings together highly curated, enriched datasets; sophisticated analytical tools; streamlined workflows; and powerful visualisations. It enables essential IP activities including competitive intelligence, benchmarking and portfolio optimisationall in one place. As part of the AI Platform team, you will help research, design and deliver the AI capabilities behind these ...

historical workloads. Collaborate closely with Risk function teams to translate business requirements into efficient, scalable and performant code. Drive continuous improvement through refactoring, performance benchmarking and adoption of best practices Mentor and guide junior and mid-level developers, fostering a culture of technical excellence, code quality and knowledge sharing. Participate ...

integration. Deliver technical workshops, onboarding sessions, product demonstrations and technical guidance. Develop and maintain integration tools, scripts, utilities and example code. Support integration testing, benchmarking and system validation. Create and maintain technical documentation and integration guides. Work closely with Product and Engineering teams to escalate issues and provide actionable customer ...

evaluation and assurance, working closely with engineering, product and data science teams. Responsibilities will include: Designing model evaluation frameworks and test harnesses Evaluating and benchmarking LLMs against real-world use cases Measuring areas including precision, recall, grounding, calibration and hallucination Red teaming systems for prompt injection, jailbreaks, data leakage ...

Engineering Strong experience with LLMs, prompt engineering and model fine-tuning Experience building, testing or deploying agentic AI systems Knowledge of model evaluation, benchmarking and MLOps best practices Passion for emerging AI technologies and solving real-world problems Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts ...

Build and maintain concurrent and asynchronous services Develop low-level components such as network services, system libraries, or runtime infrastructure. Optimize performance through profiling, benchmarking, and memory analysis. Collaborate with systems, platform, and infrastructure engineers to integrate Rust components into larger architectures. Write clean, maintainable, and well-tested code with ...

front-end development tools such as Babel, Webpack, NPM, etc. Ability to understand business requirements and translate them into technical requirements A knack for benchmarking and optimization Familiarity with git Experience with React Native is a bonus ****THIS ROLE IS OFFICE BASED ...

RANGE: £25,100 - £30,000 plus London Weighting depending on relevant skills, knowledge, and experience. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there ...

frameworks Strong, practical knowledge of agent evaluation (“evals”): task-success and trajectory testing, grounding and retrieval quality assessment, hallucination and drift detection, robustness testing, benchmarking, bias and fairness assessment, alignment and misalignment analysis, adversarial testing, and red-teaming Strong LLM/GenAI engineering fluency: prompting strategies, retrieval-augmented generation, context … identifying, assessing, and mitigating risks associated with GenAI and agentic AI Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad-hoc quantitative investigations Deliver validation outputs, from test plan design through clear, concise validation reporting and effective challenge of model developers Maintain clear ...

document root causes for the broader engineering team. Build internal tools and frameworks: Develop tools that improve operational efficiency, such as test suites, performance benchmarking frameworks, reproduction environments, diagnostic utilities, and internal dashboards that enable Ops and QA teams to resolve issues faster and validate fixes reliably. Mentor mid-level … etc.) and track record of identifying and fixing performance bottlenecks. Experience building test infrastructure: Previous work on test frameworks, load testing suites, or performance benchmarking systems. Capital markets knowledge: Familiarity with exchange technology, FIX protocols, market data formats, or trading workflows. Docker/containerization basics: Growing relevance for deployment ...

commercial data in order to uncover insights, identify trends, and support decision-making. You'll help teams answer key questions through structured analysis, benchmarking, and exploratory data work, including investigating anomalies and patterns in DAX data such as spotting trends, delivery behaviours, or product performance shifts. Analytical solution design … requirements gathering for analytical work and helped shape dashboards, reporting, or exploratory analysis that supports squad priorities • Added value to OKR discussions and benchmarking exercises through thoughtful analysis and evidence-based input What You'll Need • 3+ years experience in a Product Analyst, Data Analyst, or similar analytical role • Experience ...

automations — to improve device stability and end-user experience. Troubleshoot and remediate audio, video, and conferencing reliability issues. Perform hardware and performance testing/benchmarking to support fleet standardization decisions. Autopilot & Provisioning Modernization Modernize Windows Autopilot and provisioning workflows to reduce legacy dependencies and improve consistency. Resolve drive-mapping dependencies … Dynamic Groups, and scalable targeting strategies Endpoint Analytics and digital experience monitoring (DEX) Hardware validation and lifecycle management, including: Hardware and performance testing/benchmarking to support fleet standardization decisions Firmware and BIOS update management and deployment (e.g., HP, Dell) Wi-Fi driver troubleshooting and remediation across the device fleet ...

Build, lead and develop a team of AI researchers and engineers. Lead hands-on development across LLMs, vision models and agentic systems. Own evaluation, benchmarking, model quality and continuous improvement. Partner with product, engineering and commercial teams to deliver research into production. The Person: 5+ years' applied AI research … research through to production. Hands-on expertise with LLM/vision model training, fine-tuning, agents and evaluation. Strong understanding of model quality, benchmarking and production ML systems. Excellent research judgement, ownership and communication skills. Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts an employment agency ...

Our client is a global legal and business information company. Data Scientist III Excited to uncover insights from complex data and turn them into impactful business decisions? Do you enjoy building predictive models, experimenting with ...

agent capabilities, and work with the research engineers focused on improving the harness quality, to better align it with our customer needs via systematic benchmarking and hillclimbing on metrics that our customers care about. You will be responsible for driving the work that improves the quality of the fundamental technology … goals for the agent harness quality improvement workstream, then run its day to day execution, triage, stand-ups, status and escalation. Drive improvement through benchmarking and hillclimbing on metrics customers care about. Drive production readiness for each effort, load testing, capacity planning, quota, and the right deployment and sandbox environment ...

. Relevant experience with MITRE Att&Ck alignment with security monitoring use cases. Relevant experience with cloud security assessments aligning it to industry standard benchmarking such as CIS. In depth knowledge of a broad spectrum of security technologies incorporating network, operating system and application security; Working knowledge over a range … Information Assets. Understanding of VMware technology stack. Full understanding of CIS security standards, assessment of the builds to ensure the alignment with CIS benchmarking and working with business to achieve the target state. Knowledge of SSL inspection and encryption methods. Sound knowledge and understanding of information security principles and best ...