12 of 12 Permanent Test Harness Jobs in London

solutions meet enterprise standards for reliability, scalability, latency, maintainability, cost control, logging, monitoring, and operational support. Evaluation and quality assurance: Create evaluation datasets, test harnesses, validation tools, regression checks, and quality review workflows to measure accuracy, extraction quality, hallucination risk, and business usefulness. Architecture and technical leadership: Define solution ...

ship to production Design and implement LLM integrations including prompt engineering, function calling, structured outputs, and retrieval-augmented workflows Define evaluation criteria and build test harnesses for AI systems where correctness is ambiguous and domain-specific Work directly with clients to understand their workflows, validate AI behavior, and iterate ...

electronic communication standards: RS232, I2C, SPI, USB, etc. Experience with product compliance (RED/CE/FCC) - testing, documentation, certification. Experience with product testing harness and documentation. Experience with low power electronics design Plus experience with the following would be a bonus Experience developing PC apps to interact with … hardware, C#/Python programming experience. NI LabView for quick prototype, lab testing and test harness. Experience with RISC-V processors. Hardware test harness and firmware development for automated tests in mass production. Embedded Linux experience, Kernel cross-compilation for ARM Cortex A processors, DT, U-boot ...

ship to production Design and implement LLM integrations including prompt engineering, function calling, structured outputs, and retrieval-augmented workflows Define evaluation criteria and build test harnesses for AI systems where correctness is ambiguous and domain-specific Work directly with clients to understand their workflows, validate AI behavior, and iterate ...

pathways. Govern design quality and NFRs (availability, performance, security, operability); manage design risks and decisions. Embed AI ready patterns (secure data/logic exposure, test harnesses, guardrails for non deterministic components). Shape and deliver scalable, resilient, end to end solutions, ensuring designs are fully considered, robust and aligned ...

live telemetry. Own metric definitions and versioning so a number measured today is comparable with the same number measured six months from now. Evaluation & Test Infrastructure Develop automated test harnesses that evaluate control releases deterministically - reproducible, run-to-run comparable, free of the hidden state that makes hardware … tooling that lets engineers compare controller variants and releases side by side. Fleet-Level Control Quality Build the per-robot and per-fleet test suites that establish whether each robot meets the expected control performance bar - runnable by other teams without controls support. Track control quality over time ...

Develop quantitative control quality metrics from robot data, simulations, and live telemetry Maintain metric definitions with versioning to ensure long-term comparability Create automated test harnesses that enable reproducible and deterministic control evaluation Integrate control performance evaluation into CI pipelines with automatic regression detection Build tools for engineers … compare different control software versions effectively Design per-robot and fleet-level test suites runnable by other teams without controls expertise Monitor control performance trends such as drift, variability, and degradation across robots Develop dashboards to provide clear visibility of control health and performance Hands-on experience with robotics ...

quality engineering, you will solve complex compatibility challenges spanning operating systems, databases, application platforms, partner agents, and container ecosystems. What You'll Do Engineer, test, and validate hardened RHEL server images. Build automated validation frameworks and integration test harnesses. Develop CI/CD-driven validation pipelines with measurable … Bring Strong hands-on RHEL administration and troubleshooting experience. Expertise in automation using Python, Go, Bash, and/or Ansible. Experience designing automated test frameworks and integration validation solutions. Strong CI/CD and release engineering experience. Experience with containers, OpenShift, Kubernetes, and virtualization technologies. Knowledge of observability platforms ...

taking accountability for delivery from design through to running in production. Build and evolve the project’s evaluation and observability capabilities, including test harnesses, offline and online evaluations, regression suites, tracing, and fallbacks, so that safety, reliability, cost and latency are measurable and controlled in production. Work directly with … direction and vision. Strong understanding of the concepts underpinning agentic AI systems, including multi-agent orchestration, tool use, memory and context management, RAG, and harness/loop engineering. Understanding of classical ML is a plus. Hands-on production experience with modern agentic AI frameworks, including taking at least ...

AI Product Analyst Our client is building cutting-edge AI products for their customers and for colleagues across the group, in tax, HR, health and safety, and care. We can see that people use them ...

Tricorder — Clinical Infrastructure for Field Operations We're looking for a hands-on engineer to build two foundations of the Tricorder product: the evaluation harness and training data pipeline behind our AI models, and a clinical knowledge base grounded in tactical combat care, SNOMED CT and ICD-10. About … workstreams, working day to day with the founder and the FF build team. 1. Data pipeline and evaluation harness Build the data foundations that tell us whether our models are good enough for clinical use. Data labelling: design labelling schemas and guidelines, set up tooling, and run labelling with ...

Engineers – Responsibilities & Skills Responsibilities Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact. Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi‐step workflows. Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs … servers and Skills. Help define the long‐term quality and governance model for federated MCP contributions across LSEG. Skills Strong Python experience for test harnesses and automation. Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines. Test automation expertise covering unit, integration, and regression testing. Understanding ...