1 to 25 of 87 A/B Testing Jobs

Senior UX / UI or Product Designer with a specialized focus on Conversion Rate Optimisation (CRO) and experimentation to join our dynamic, flexible team, Embedded directly within our dedicated CRO squad. The opportunity: We are seeking a highly skilled and passionate UX / … within a cross-functional CRO squad, you will be responsible for the end-to-end design life cycle of A / B and multivariate tests, ensuring every design is both meticulously executed and strategically optimized for maximum performance. What you'll be doing ...

Requirements / h3 ul li Bachelor's, Master’s, or PhD or equivalent experience in Computer Science, Machine Learning, Applied Mathematics, Statistics, Financial Engineering, or a related quantitative field / li , li Significant professional experience (typically 7–12+ years) in AI / ML product development … / management, model validation, quantitative research, risk modelling, or related areas / li , li Demonstrated success working with technical teams or senior specialists in high stakes modelling environments / li , li Deep understanding of AI / ML systems including LLMs, agentic architectures, RAG pipelines, credit ...

customers with their shopping tasks at every step of their shopping journey. This innovative role focuses on developing and optimizing language model‐powered (LLM / SLM) conversational experiences. The core emphasis is to get the best performance out of LLMs / SLMs via careful and methodical instruction design … contextual grounding, informed choices of MCP tools and agent / multi‐agent systems, context engineering, model fine‐tuning, evaluation frameworks, and experimentation to systematically improve quality, robustness, and customer impact. The work combines scientific rigor with product intuition to systematically raise the bar for conversational AI performance at Amazon ...

content is discoverable, accessible, and performs well in search and AI applications. You will drive improvements to digital publishing using analytics, A / B testing, and collaboration with stakeholders, while training team members on publishing tools and best practices. RSSB's website … reach and effectiveness. Use analytics tools to track content performance, user engagement, and consumption trends, providing actionable insights. Design and execute A / B tests on an ongoing basis to evaluate content effectiveness and inform publishing strategies. Collaborate with content creators, designers, and technical teams ...

Responsibilities Own the full website user experience, ensuring journeys are intuitive, frictionless, and aligned to customer needs. Lead CRO activity including A / B testing, user testing, heatmaps, and behavioural analysis. Translate insights into clear recommendations that improve conversion and engagement. … teams and influencing decision-making. Manage the backlog of website improvements and prioritise based on impact. Monitor performance metrics and report on key UX / CRO outcomes. Act as the internal voice of the customer, ensuring digital decisions are insight-led. About You This role suits someone ambitious, proactive ...

Base location: Leeds – very occasional travel if required) Duration: 6 months initial About the Role Exalto Consulting are working with a healthcare / public sector client looking to bring in an experienced User Researcher to support the delivery of digital products and services. This role will lead … service decisions. Producing decision-ready synthesis, including insight frameworks, opportunity maps and journey evidence. Designing and evaluating experiments, including prototypes, A / B testing and multivariate testing where appropriate. Working closely with product managers, designers, analysts, delivery teams and senior stakeholders. ...

from concept through to launch Work with Shopify Liquid, APIs and third-party integrations Develop responsive web experiences using JavaScript, jQuery, HTML and CSS / SCSS Create intuitive and user-friendly backend environments for website administrators Utilise AI development tools to support theme creation and development workflows Support data … migration and synchronisation between Shopify and external platforms Implement website performance optimisation and best practice development standards Assist with A / B testing, SEO implementation and data-driven improvements Collaborate across multiple projects while managing priorities effectively Troubleshoot technical issues and contribute innovative ...

Support evaluation of downstream applications (including GenAI-powered features) where they depend on retrieval quality. Experimentation & Reporting Help design and lead A / B testing and experimentation frameworks for search and ranking improvements. Partner with product and data science to define success metrics … Tableau, Power BI, Looker, matplotlib, seaborn) Experience working with Databricks or similar large-scale data platforms Excellent understanding of experimentation design, A / B testing, and statistical analysis Experience defining and analyzing search / retrieval metrics (e.g., NDCG, recall, precision, ranking metrics ...

e.g., NDCG, recall, precision) LLM and RAG evaluation methodologies Grounding and faithfulness evaluation Human evaluation and annotation strategies Online experimentation and A / B testing Establish best practices for offline benchmarking, online experimentation, and reproducible evaluation workflows. Build scalable processes for benchmark creation … systems. Information retrieval and semantic search Retrieval-augmented generation (RAG) Evaluation methodologies for IR and generative AI systems Experimentation frameworks and A / B testing Strong experience with: Vector retrieval and hybrid search architectures. LLM evaluation and AI quality measurement Embeddings, reranking ...

direction and standards across a broad area, drive architecture and engineering excellence, and partner closely with Product, Design, Engineering Leadership and Data / Analytics to turn customer and business needs into coherent, measurable outcomes. You'll play a key role in helping teams make good … supporting services, ensuring solutions are scalable, maintainable and aligned with the broader platform direction Champion an experimentation-first approach, embedding A / B testing, measurement and iteration into the way teams build, validate and evolve experiences Raise the engineering bar across teams ...

covered for death in service life cover of up to three times annual pay Health and Wellbeing support and resources including our 24 / 7, confidential Employee Assistance Programme and Virtual GP for you and your family. A great holiday package About the role At Booker, part … roadmap Lead end-to-end analysis – from gathering requirements and defining success metrics to delivering actionable insights Design, run and analyse A / B tests to continuously optimise the customer experience Use data from multiple sources to identify trends, answer business questions and uncover ...

decisions. Technology is at our core and innovation is everywhere. But our company is more than datasets, lines of code or A / B tests. We're the thrill of the first night in a new place. The excitement of the following morning. … directly related to the Trip Helpfulness aspect of the Connected Trip. Key Job Responsibilities and Duties: Owns and sets the vision for their product / feature, informed by data, user research and overarching vision of their product area Lays out a 1y strategy to achieve the vision ...

Design and deliver scalable reporting, dashboards, and data solutions Partner with cross-functional teams including Product, Engineering, and Business stakeholders Conduct A / B testing and experimentation to evaluate product and feature performance Build and maintain high-quality datasets for advanced analytics Translate … team What We're Looking For Proven experience in Data Analytics or a similar role Strong SQL skills and experience with Python / PySpark Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A / B testing ...

marketing stakeholders to optimise campaigns and improve ROI Provide insight into customer acquisition, engagement, retention and lifetime value Design and analyse A / B tests to support experimentation and performance improvement Build dashboards and enable self-serve analytics for non-technical stakeholders Collaborate with product … working with large datasets Proven experience in performance analytics within a digital environment Hands-on experience with experimentation and A / B testing Familiarity with tools such as Google Analytics or similar platforms Experience with data visualisation tools such as Looker ...

. What you'll be doing Own the experimentation roadmap and CRO strategy across the full customer journey Design and run A / B tests across email, website, and direct marketing channels Identify customer pain points and define optimisation opportunities Work with UX, engineering … continuous optimisation Drive a culture of data-driven experimentation across the business What you bring Must-haves Strong experience working in CRO / experimentation / optimisation roles Proven experience owning an experimentation roadmap (not just contributing) Hands-on experience running A / B ...

LGBTQ+ business community. Please do not contact the recruiter directly. Requisition ID36865Office CountryUnited KingdomOffice CityLondonDivisionInformation TechnologyContract TypeShort Term Contract Length12 months Posting End Date08 / 07 / 2026 Purpose of Job The Associate Director, Capability Lead is a key leadership role in each capability domain area … stakeholder management The capability area operates in a flat, agile, self-organising manner and will be comprised of many product aligned Squads / Scrums. The AD is accountable for the delivery of the Product Owners vision aligned to the IT department technical strategy and direction and will ...

Product Analyst - £55,000 (Hybrid - London) Industry: Consumer Marketplace / Mobile App Department: Product & Insights We're looking for a Product Analyst to join a fast-growing consumer marketplace used by millions globally. You'll work closely with product managers, designers, and engineers to uncover … Analyse user behaviour and product performance across key journeys Build dashboards and self-serve insights for cross-functional teams Support A / B testing: design experiments, interpret results, recommend next steps Work with data and platform teams to ensure clean, scalable datasets Present ...

driven testing and optimisation. What you'll be doing: Building testing strategies and hypotheses Designing and analysing A / B and multivariate tests Delivering insights and recommendations to clients Running client meetings and stakeholder workshops Producing reports, presentations and optimisation roadmaps … What we're looking for: 4+ years' experience in CRO, experimentation or digital analytics Strong A / B testing and optimisation experience Excellent stakeholder management and communication skills Experience with tools such as Webtrends Optimize, VWO, Optimizely, AB Tasty or similar Passion ...

execution across multiple digital platforms. The Role Support the build-out of an experimentation centre of excellence Translate business OKRs into A / B testing roadmaps Own test prioritisation, ideation and execution Run experiments end-to-end (design launch analysis insight) Work closely … hands-on role - you'll need to think strategically while still being able to execute and deliver. About You Proven experience running experimentation / CRO programmes Hands-on experience building and analysing A / B tests Strong understanding of experimentation principles & metrics Experience with ...

across platforms. Evaluation & Experimentation Leadership Define and operationalise evaluation frameworks for search and generative AI systems, including IR metrics (NDCG, recall, precision) and LLM / RAG evaluation methodologies. Develop grounding and faithfulness evaluation, human evaluation, and annotation strategies. Design online experimentation and A / B … search relevance and ranking systems, semantic search, retrieval‐augmented generation, evaluation methodologies for IR and generative AI, experimentation frameworks and A / B testing. Strong experience with vector retrieval and hybrid search architectures, LLM evaluation and AI quality measurement, embeddings, reranking, and retrieval orchestration. Experience ...

globally. Collaborate with engineering teams to integrate data science models seamlessly into our tech stack. Experimentation & Insights Design and execute rigorous A / B tests to validate new features, algorithms, and product iterations. Apply advanced statistical and probability theory to evaluate model performance and user … scheme. Wellbeing: Amongst other things, enhanced maternity and paternity leave; 25 days paid holiday per year plus 8 bank holidays; 3 paid volunteer days / year; Summer hours through July and August (we finish at 4pm on a Friday); and a full programme of wellbeing ...

Centre of Excellence for experimentation across digital teams Translate business objectives and OKRs into clear experimentation roadmaps Prioritise, design and execute A / B tests across web and digital platforms Act as a hands-on experimentation specialist, not just test execution but strategic … Experience Strong experience running experimentation or CRO programmes in a digital environment Hands-on experience setting up and analysing A / B tests Solid understanding of experimentation principles, metrics and statistical concepts Experience with digital analytics and experimentation tools such as GA4, Optimizely ...

a wide range of market leading InsurTech solutions. You will join us at an exciting time as we focus increasingly on cloud / SaaS solutions, upgrading existing products to new technologies and modern UX, as well as developing brand-new applications. This role combines the strategic thinking … architects, and business stakeholders to shape the product vision, manage the backlog, and drive high‐quality delivery through modern software development practices including CI / CD, infrastructure‐as‐code, cloud-native architectures, and automated testing. This position is ideal for someone who enjoys bridging technology and business, has strong ...

IMPACT As a Data Scientist / Machine Learning Scientist in the Global Markets Division, you will be at the forefront of innovation on the trading floor. You will design and implement advanced machine learning models, including predictive AI, to uncover complex market trends and generate actionable insights. … through advanced analytics, predictive modelling, and the application of recommendation systems. Our data scientists and machine learning engineers are applying advanced quantitative and AI / ML techniques to solve the most complex business challenges in a dynamic, entrepreneurial team with a passion for the markets. ...

Digital Analyst - Retail Media & CRM (Contract) London (Hybrid) £500-£550 per day (Inside IR35) 6 Months We're hiring a Senior Analyst to join a growing Analytics & Data Science team, supporting a high-impact Retail Media function . This role is focused on leveraging … Strong Retail Media experience (ESSENTIAL) - including audience targeting, activation and performance measurement Advanced SQL plus experience with Python or R Proven experience in CRM / marketing analytics and campaign optimisation Strong understanding of statistical analysis (A / B testing, hypothesis testing ...