1 to 25 of 127 Permanent Benchmarking Jobs in the UK excluding London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

secure, maintainable, and aligned with business objectives.Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment.Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment.Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value.Guide architectural decisions ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

consistency, and quality across reporting outputs Contributing to process improvements and reporting automation initiatives Presenting insights to both technical and non-technical stakeholders Supporting benchmarking and performance reporting activities Skills and Experience Previous experience within a Data Analyst, MI Analyst, Reporting Analyst, or Business Intelligence role Strong analytical and problem ...

across the lifecycle: experimentation, versioning, CI/CD, deployment, monitoring, and maintenance for models/prompts/agents.Implement robust testing (unit/integration), performance benchmarking (latency/cost), and observability (logging/metrics/tracing) for AI services.Collaborate with cross-functional stakeholders to define requirements, success metrics, and rollout plans ...

orchestration Experience building reusable internal libraries or frameworks that accelerate team delivery and promote engineering consistency Familiarity with advanced LLM evaluation techniques, including automated benchmarking, red-teaming, and latency/cost profiling in production Experience with gRPC and Protobuf-based service design in distributed, high-throughput environments Exposure to platform ...

Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

reviews, onboarding support, and corrective action follow-up. Support supplier relationships and contract performance with Procurement, Legal, Compliance, and Regional Operations. Use scorecards and benchmarking to identify service, cost, compliance, and value-creation opportunities. Cross-functional Collaboration, Digital Enablement & Team Leadership (10%) Act as a key interface between ...

twins or service virtualisations of external systems for agent evaluation environments. Experience with LLM evaluation at scale: eval suites, red-teaming AI-generated code, benchmarking agent workflows. Multi-tenant SaaS architecture experience, CDC/event-driven ingestion (Debezium, Kafka, RabbitMQ/MassTransit), or lakehouse exposure (Microsoft Fabric). Azure services ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

ready identity constructs and can leverage AI where useful for reporting and review Drive engineering excellence through design reviews, reference architectures, coding standards, performance benchmarking, and reliability engineering practices as part of existing governance processes Coach and grow engineers, providing technical guidance and fostering a culture of quality, ownership ...

Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering ...

strategy.Build and manage a multi-year value pipeline across cost optimisation, software rationalisation, demand management, risk reduction and innovation.Use market intelligence, supplier insights and benchmarking to shape strategic decisions and identify new opportunities.Act as Procurement's AI Champion for AI-enabled software and emerging technologies, providing leadership, guidance and governance ...

Project Boards/Working groups and Exec Steer Co including the monitoring, review and reporting on all project and programme attributes Lead on benchmarking of published peer reports to collect and disseminate relevant information to enable a comparison of material impacts, risks and opportunities as well as the approach ...

Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering ...

RPWithin Accenture, the Finance Reinvention Partner helps clients improve financial performance around the CFO agenda — driving best-in-class performance, and sharper insight and benchmarking across the enterprise. In the UK and Ireland, our Finance RP practice brings together finance strategy and the platforms it runs on, including SAP, Oracle ...

RPWithin Accenture, the Finance Reinvention Partner helps clients improve financial performance around the CFO agenda — driving best-in-class performance, and sharper insight and benchmarking across the enterprise. In the UK and Ireland, our Finance RP practice brings together finance strategy and the platforms it runs on, including SAP, Oracle ...

risks Define and track key architectural metrics and milestones throughout the chip development lifecycle (pre-RTL through tape-out and post-silicon validation) Support benchmarking and performance analysis efforts, helping teams understand where the system delivers against AI workload targets and where it falls short What We're Looking ...

realise quality and financial targets across Urgent and Planned Care. Utilising detailed data analysis including quantitative and qualitative sources as well as intelligence from benchmarking and best practice to identify performance challenges and opportunities within the Trust. To lead on strategic improvement, identifying solutions to identified areas of focus ...

decision makers to support the delivery of excellent services, the maintenance of high-quality homes and the ability to make efficient and effective decisions. Benchmarking – comparing Newlon’s performance with other organisations to demonstrate areas of good practice and identify opportunities for improvement. Insight – applying your critical thinking and communication ...

including currency icon e.g. £47,000 - £57,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights. We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there ...

across HPC compute, cloud, Emulation and FPGA environments.Responsibilities:Platform Optimization and Systems Engineering: Contributing to improvements in HPC scheduling and infrastructure efficiency.Assist with performance benchmarking activities, to help support platform decisions.Observability and Performance Analysis: Developing dashboards and visualisations.Cost and Resource Optimisation: Analysing Cost and Usage Reports (CUR) and infrastructure metrics ...