1 to 25 of 134 Benchmarking Jobs in the UK excluding London

aligned with business objectives. Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment. Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment. Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value. Guide architectural ...

secure, maintainable, and aligned with business objectives.Provide deep expertise in model development, experimentation, optimization, evaluation, and production deployment.Establish standard methodologies for LLM evaluation, model benchmarking, AI quality measurement, and performance assessment.Evaluate emerging AI technologies, foundation models, and third-party solutions to find opportunities for innovation and business value.Guide architectural decisions ...

assessment, and mitigation of risks specific to GenAI and agentic AI. Design and deliver complex validation analyses, including model replication, challenger development, sensitivity testing, benchmarking, and ad hoc quantitative investigations. Own validation outputs end to end, from test plan design through clear, concise validation reporting and effective challenge of model ...

consistency, and quality across reporting outputs Contributing to process improvements and reporting automation initiatives Presenting insights to both technical and non-technical stakeholders Supporting benchmarking and performance reporting activities Skills and Experience Previous experience within a Data Analyst, MI Analyst, Reporting Analyst, or Business Intelligence role Strong analytical and problem ...

consistency, and quality across reporting outputs Contributing to process improvements and reporting automation initiatives Presenting insights to both technical and non-technical stakeholders Supporting benchmarking and performance reporting activities Skills and Experience Previous experience within a Data Analyst, MI Analyst, Reporting Analyst, or Business Intelligence role Strong analytical and problem ...

across the lifecycle: experimentation, versioning, CI/CD, deployment, monitoring, and maintenance for models/prompts/agents.Implement robust testing (unit/integration), performance benchmarking (latency/cost), and observability (logging/metrics/tracing) for AI services.Collaborate with cross-functional stakeholders to define requirements, success metrics, and rollout plans ...

orchestration Experience building reusable internal libraries or frameworks that accelerate team delivery and promote engineering consistency Familiarity with advanced LLM evaluation techniques, including automated benchmarking, red-teaming, and latency/cost profiling in production Experience with gRPC and Protobuf-based service design in distributed, high-throughput environments Exposure to platform ...

Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering ...

onboard suppliers Apply judgement to data, identifying data quality issues and suggesting solutions and improvements to data and reporting processes Perform trend analysis and benchmarking to identify opportunities for improvement Ensure all sources and recipients of sustainability data are clearly defined and captured Responsible for finding new ways of working ...

built large systems yet. Curiosity about LLMs and AI model architecture, with willingness to learn quickly. A measurement-driven mindset: you like profiling, benchmarking, and proving improvements with data. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

reviews, onboarding support, and corrective action follow-up. Support supplier relationships and contract performance with Procurement, Legal, Compliance, and Regional Operations. Use scorecards and benchmarking to identify service, cost, compliance, and value-creation opportunities. Cross-functional Collaboration, Digital Enablement & Team Leadership (10%) Act as a key interface between ...

twins or service virtualisations of external systems for agent evaluation environments. Experience with LLM evaluation at scale: eval suites, red-teaming AI-generated code, benchmarking agent workflows. Multi-tenant SaaS architecture experience, CDC/event-driven ingestion (Debezium, Kafka, RabbitMQ/MassTransit), or lakehouse exposure (Microsoft Fabric). Azure services ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

management information across services. Ensure the quality, accuracy and integrity of all published data, analysis and reporting. Produce insightful analysis, commentary, trend identification and benchmarking to support operational and strategic decision making. Develop reporting solutions and support the automation of management information processes. Work closely with senior stakeholders, IT teams ...

ready identity constructs and can leverage AI where useful for reporting and review Drive engineering excellence through design reviews, reference architectures, coding standards, performance benchmarking, and reliability engineering practices as part of existing governance processes Coach and grow engineers, providing technical guidance and fostering a culture of quality, ownership ...

Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering ...

strategy.Build and manage a multi-year value pipeline across cost optimisation, software rationalisation, demand management, risk reduction and innovation.Use market intelligence, supplier insights and benchmarking to shape strategic decisions and identify new opportunities.Act as Procurement's AI Champion for AI-enabled software and emerging technologies, providing leadership, guidance and governance ...

Project Boards/Working groups and Exec Steer Co including the monitoring, review and reporting on all project and programme attributes Lead on benchmarking of published peer reports to collect and disseminate relevant information to enable a comparison of material impacts, risks and opportunities as well as the approach ...

Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering ...

RPWithin Accenture, the Finance Reinvention Partner helps clients improve financial performance around the CFO agenda — driving best-in-class performance, and sharper insight and benchmarking across the enterprise. In the UK and Ireland, our Finance RP practice brings together finance strategy and the platforms it runs on, including SAP, Oracle ...

RPWithin Accenture, the Finance Reinvention Partner helps clients improve financial performance around the CFO agenda — driving best-in-class performance, and sharper insight and benchmarking across the enterprise. In the UK and Ireland, our Finance RP practice brings together finance strategy and the platforms it runs on, including SAP, Oracle ...

risks Define and track key architectural metrics and milestones throughout the chip development lifecycle (pre-RTL through tape-out and post-silicon validation) Support benchmarking and performance analysis efforts, helping teams understand where the system delivers against AI workload targets and where it falls short What We're Looking ...

realise quality and financial targets across Urgent and Planned Care. Utilising detailed data analysis including quantitative and qualitative sources as well as intelligence from benchmarking and best practice to identify performance challenges and opportunities within the Trust. To lead on strategic improvement, identifying solutions to identified areas of focus ...