Technical CRO Consultant (AI-Focused Testing)

Technical CRO Consultant, AI Product Experimentation London, Outside IR35, £400-440/day

This is an opportunity to help shape the rollout of AI-native products at scale. The business is investing heavily in conversational AI, recommendation engines, decisioning tools and agentic AI experiences, and needs a hands-on CRO specialist who can ensure these products deliver measurable commercial impact through robust experimentation and optimisation.

The Company

They are a large, customer-focused organisation undergoing significant digital and AI transformation. Their established experimentation function has strong foundations in traditional testing and optimisation. As AI-powered experiences become a growing part of the customer journey, they are looking to add specialist expertise to bridge the gap between CRO and AI product delivery. This project is expected to evolve as new AI workstreams are uncovered across the organisation.

The Role and Deliverables

• Lead experimentation and conversion optimisation activities across AI-powered digital products and customer experiences.
• Design, implement and evaluate tests for conversational AI, recommendation engines, decisioning tools and other AI-native products.
• Work closely with product, engineering and AI teams to ensure accurate instrumentation, tracking and measurement of performance.
• Use feature flagging and experimentation platforms to understand which experiences, features and AI models are driving commercial outcomes.
• Debug and validate experiment implementations, ensuring data quality and reliable reporting.
• Champion a conversion-focused mindset by challenging assumptions and evaluating the commercial impact of AI product decisions.

Your Skills & Experience

• Strong hands-on experience in Conversion Rate Optimisation (CRO) and digital experimentation.
• Experience testing, optimising or launching AI-powered products, including chatbots, conversational interfaces or LLM-based experiences.
• Practical knowledge of feature flagging platforms tools such as Launch Darkly or Statsig.
• Experience with platforms such as Optimizely, VWO, Adobe Target or similar technologies.
• Comfortable working alongside engineers and technical stakeholders, with the ability to translate business objectives into testable hypotheses.
• Strong understanding of instrumentation, analytics, debugging and experiment measurement.
• Commercially focused, with the ability to connect experimentation outcomes to conversion and business performance.
• Genuine interest in AI technologies and how they influence customer behaviour and digital experiences.

How to Apply

If you have a blend of CRO expertise and hands-on experience working with AI-powered digital products, please apply with your latest CV.