76 to 100 of 110 Regression Testing Jobs in London

Designing and evaluating multi-agent workflows, including delegation, shared context, permissions, and termination conditions. Creating synthetic test data, adversarial test cases, evaluation datasets, and regression tests for AI experiments. Career Stage Manager London Stoc #J-18808-Ljbffr ...

Senior Software Development Engineer in Test (SDET)Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentAdvance your testing career while shaping digital finance with automationThe RoleCapco is growing our Engineering team and we're looking for experienced SDETs with a passion for delivering innovative solutions in financial services. … automated scripts, and quality reporting to support end-to-end delivery.Manage test environments and generate reliable, consistent test data to support functional, integration, and regression testing.Execute UI and API automation using modern testing frameworks while integrating automated testing into CI/CD pipelines.Collaborate with engineers and cross ...

through to successful resolution. Manage system developments, enhancements and configuration changes from requirements gathering through to implementation. Coordinate and oversee Oracle Cloud quarterly updates, regression testing and essential system maintenance activities. Manage and support integrations between feeder systems and Oracle Cloud using the PaaS platform. Work collaboratively with … support providers to ensure service excellence. Provide expert advice and guidance to stakeholders on Oracle Cloud functionality and best practice. Ensure change management processes, testing standards and governance procedures are adhered to. Build strong relationships with key business users, service managers and external partners. If you are interested ...

Diagnose, debug, and resolve both probabilistic and technical failures through root‐cause analysis of execution traces, error logs, and model behavior. Design evaluation and regression‐testing frameworks to validate agent behavior against ground truth and guard against performance drift. Translate customer needs into clear internal documentation … comfortable writing code, working with APIs, and building/validating integrations end‐to‐end. Experience delivering production‐grade customer solutions that require structured execution, testing/validation, and iteration. Ability to communicate clearly with senior technical stakeholders, translate requirements into implementation plans, and drive delivery. Comfort working in fast ...

improvements.Implement and validate optimisations in compilers, runtimes, and/or kernels (e.g. operator fusion, scheduling, quantisation-aware performance, custom kernels).Build robust benchmarking and regression testing to ensure performance improvements hold across models, devices, and software releases.Optimise for multiple targets (e.g. NVIDIA Orin/Thor, Qualcomm) and work … operating at multiple levels of abstraction — from high-level model behaviour down to low-level kernel/runtime execution.Strong software engineering fundamentals (debugging, profiling, testing, and maintainable code).Clear communicator and collaborative teammate; able to align multiple stakeholders on performance trade-offs and priorities.DesirableExposure to embedded or edge deployment ...

Diagnose, debug, and resolve both probabilistic and technical failures through root-cause analysis of execution traces, error logs, and model behavior. Design evaluation and regression-testing frameworks to validate agent behavior against ground truth and guard against performance drift. Translate customer needs into clear internal documentation … comfortable writing code, working with APIs, and building/validating integrations end-to-end. Experience delivering production-grade customer solutions that require structured execution, testing/validation, and iteration. Ability to communicate clearly with senior technical stakeholders, translate requirements into implementation plans, and drive delivery. Comfort working in fast ...

design the patterns that make multi-agent systems reliable.Build the evaluation and quality infrastructure. Automated eval pipelines, human-in-the-loop review systems, regression testing for prompt changes, domain-specific quality metrics. You treat evaluation as a first-class engineering concern and build the systems that make … with engineering teams across London and designing interfaces that serve both sides well.Set the standard. You define patterns for prompt management, retrieval, guardrails, and testing that the wider team and eventually the whole organisation adopts — and that, in time, shape how the companies who learn from Multiverse do this ...

pinpoint bottlenecks across the full inference stack (model graph, compiler/runtime, kernel execution, memory movement) and deliver measurable improvements.Build robust benchmarking and regression testing to ensure performance improvements hold across models, devices, and software releases.Develop and optimise for multiple target platforms (e.g. NVIDIA Orin/Thor, Qualcomm … operating at multiple levels of abstraction — from high-level model behaviour down to low-level kernel/runtime execution.Strong software engineering fundamentals (debugging, profiling, testing, and maintainable code).Clear communicator and collaborative teammate; able to align multiple stakeholders on performance trade-offs and priorities.DesirableExperience with compute graph scheduling ...

pinpoint bottlenecks across the full inference stack (model graph, compiler/runtime, kernel execution, memory movement) and deliver measurable improvements. Build robust benchmarking and regression testing to ensure performance improvements hold across models, devices, and software releases. Develop and optimise for multiple target platforms (e.g. NVIDIA Orin/… multiple levels of abstraction — from high-level model behaviour down to low-level kernel/runtime execution. Strong software engineering fundamentals (debugging, profiling, testing, and maintainable code). Clear communicator and collaborative teammate; able to align multiple stakeholders on performance trade‐offs and priorities. Desirable Experience with compute graph ...

shipping production LLM features Experience with agent frameworks, tool calling, and multi-step orchestration Production evals chops: dataset curation, LLM‐as‐judge failure modes, regression testing under model swaps Strong systems thinking: async, queues, idempotency Comfort being the named owner of AI quality, including saying no when needed ...

outputsPartnering with SMEs and Leadership to help translate business requirements into scalable, insightful outputsChampioning automation, standardisation, and the adoption of best practicesSupporting system upgrades, regression testing, enhancements, and integrations from a systems reporting and UI perspectiveWhat we are looking for:We value diverse experiences and perspectives. Here ...

long-running state, recovery from partial failures) and when to reach for each. You’ve built evals infrastructure (like datasets, LLM as judge, prompt regression tests, monitoring) and have a clear view of what good looks like. You respect the weight of building business-critical systems ...

developers and improve team capability across C#/.NET, OpenShift, MongoDB, SQL, messaging, platform engineering and modern engineering practices. Ensure appropriate unit, integration, contract, regression, performance and system testing is applied, and support UAT, release preparation, cutover and early‐life support. Liaise with business users, methodology teams, delivery … systems where resilience, supportability, auditability, security and controlled change are important. Experience applying engineering best practice including loose coupling, contract‐first design, idempotency, automated testing, secure coding, observability and operational readiness. Experience leading people to deliver, including mentoring, work allocation, delivery tracking, quality review and constructive challenge, while remaining ...

approach, RBAC model and application architecture needed for repeatable delivery. The developer will bring extensive experience in productionising and securing Django applications, embedding automated testing, CI/CD and agile development practices, and creating documentation to support Technical Design Authority (TDA), security assurance and operational handover. Responsibilities Lead … secure application access models. Set up and improve CI/CD pipelines, automated quality controls, infrastructure‐as‐code and deployment practices. Establish repeatable automated testing approaches across unit, integration, functional and regression testing. Produce and assure technical documentation for TDA, security assurance, onboarding and ongoing operations. Collaborate with ...

data loading and caching pipeline. Implement performance profiling across the ML systems stack Develop internal metrics and monitoring for training runs. Build reproducibility and regression testing infrastructure. Develop a performant fault-tolerant distributed checkpointing system. Full-Time Employees at Cohere enjoy these Perks: A weekly lunch stipend ...

Remote from EU position with 8+ years of related experience; strong debugging and collaboration with design teams are essential for timely verification closure and regression testing. #J-18808-Ljbffr ...

business works. Embedded directly with business teams, you will take ownership of AI-enabled workflows from discovery and design through to build, testing, deployment, monitoring and handover. This is a senior, hands‐on delivery role for someone who can work independently across architecture, integration, DevOps, MLOps, AIOps, data engineering … voice within embedded initiatives, setting engineering standards, guiding Applied AI Engineers and business teams, and making sound architecture and integration decisions within agreed guardrails. Testing, validation and quality assurance: Plan and execute functional, regression and edge-case testing, including failure scenarios, fallback paths, escalation triggers and data ...

days per week in London Outside IR35, start ASAP. Role overview: The Test Manager will be responsible for defining and executing the overall testing strategy for a complex ERP programme, ensuring all solution components — from processes to integrations — are thoroughly tested and validated before deployment.The role will cover planning … multiple workstreams and business teams.Key responsibilities:Develop and own the programme-wide test strategy, approach and governance. Define test phases including UT, SIT, UAT, regression, performance testing and cutover validation. Prepare the master test plan, including scope, timelines, environments, entry/exit criteria, resources and tools. Coordinate testing ...

prove them end-to-end, then broaden.Job ResponsibilitiesBuild and evolve engineering productivity tooling: systems that help developers make changes with confidence, covering change management, regression and behaviour-comparison testing, and codebase health at scaleBuild and evolve operational tooling: real-time monitoring, alerting, and workflow frameworks that give Operations … assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted ...

then broaden. Job Responsibilities Build and evolve engineering productivity tooling: systems that help developers make changes with confidence, covering change management, regression and behaviour-comparison testing, and codebase health at scale Build and evolve operational tooling: real-time monitoring, alerting, and workflow frameworks that give Operations users … assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team. Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized ...

business works. Embedded directly with business teams, you will take ownership of AI-enabled workflows from discovery and design through to build, testing, deployment, monitoring and handover.This is a senior, hands-on delivery role for someone who can work independently across architecture, integration, DevOps, MLOps, AIOps, data engineering … Applied AI Engineers and business teams, and making sound architecture and integration decisions within agreed guardrails.Testing, validation and quality assurance: Plan and execute functional, regression and edge-case testing, including failure scenarios, fallback paths, escalation triggers and data quality checks. Assess when workflows are ready for production release.Rapid ...

Kong, Japanese and European configurations. Each solution blueprint defines a number of components that make up the solution, the integration requirement and integration and regression test packs. The Product Manager will be responsible for defining the end-to-end component integration requirements for Standard Configurations. Working closely with development … validate designs and establish build plans for integrating components into Solutions. Defining acceptance criteria for end-to-end solutions. Assisting in the definition of regression and integration testing scenarios for standard configurations. Resolving component integration issues and managing dependencies across component product dev plans. Liaising with customer implementation ...

Kong, Japanese and European configurations. Each solution blueprint defines a number of components that make up the solution, the integration requirement and integration and regression test packs. The Product Manager will be responsible for defining the end-to-end component integration requirements for Standard Configurations. Working closely with development … validate designs and establish build plans for integrating components into Solutions. Defining acceptance criteria for end-to-end solutions. Assisting in the definition of regression and integration testing scenarios for standard configurations. Resolving component integration issues and managing dependencies across component product dev plans. 3. Liaising with customer ...

sources to BigHand’s cloud environments. The Senior SDET’s aim is to write robust and comprehensive automated tests at all levels of the Testing Pyramid to deliver quality products – from Unit Tests (if required), through Component Integration tests all the way to back end API and front … software products and services. Takes ownership for delivering high-quality software. Writes automated Component Integration, API, and E2E tests, building/maintaining a Regression Test library. Collaborates with developers/business analysts to design automated tests using a BDD approach. Recommends strategies and methods to improve test plans ...

control, and hardware layers. Translate research prototypes into scalable, maintainable, and testable control software. Apply modern software development practices (CI/CD, code reviews, testing frameworks, documentation). Define reliability, latency, and safety metrics and enforce them throughout the control stack. Lead the integration of real-time control software … embedded or Linux-based systems, ensuring consistent behavior across hardware targets. Develop automated testing frameworks (simulation, hardware-in-the-loop, regression, and performance testing). Drive release and version management of the control stack, ensuring stability across branches and deployments. Conduct profiling, benchmarking, and performance validation ...