1 to 25 of 159 A/B Testing Jobs

Senior UX / UI or Product Designer with a specialized focus on Conversion Rate Optimisation (CRO) and experimentation to join our dynamic, flexible team, Embedded directly within our dedicated CRO squad. The opportunity: We are seeking a highly skilled and passionate UX / … within a cross-functional CRO squad, you will be responsible for the end-to-end design life cycle of A / B and multivariate tests, ensuring every design is both meticulously executed and strategically optimized for maximum performance. What you'll be doing ...

their own routes independently Driving customer activation through data, design and experimentation using conversion funnels, AI-generated insights, competitor benchmarks, and A / B testing to identify and capture opportunities route by route and also global step changes. Collaborating across the organization working … experienced product manager (5+ years) who has solved complex customer-facing problems at global scale, ideally in fintech. You have experience with AI / ML-powered products - whether building conversational experiences, recommendation systems, or other AI-first features. You understand the unique challenges of shipping non-deterministic products (LLMs ...

Core Focus) Own the design and evolution of evaluation frameworks for LLM-based systems (both offline and online) Build and scale A / B testing to measure real customer impact and guide product decisions Define meaningful metrics that connect system performance to customer … clarity to ambiguous problem spaces and turn them into actionable changes to the system Cross-functional Collaboration Work daily with Product, Engineering, and Content / Design to shape the assistant’s behaviour Influence decisions about the product through clear communication, data visualisations, and well-structured impactful proposals. Ensure ...

expansion underway. This is a role for a growth PM who knows the goal isn't running A / B tests - it's conversion. Here, the funnel isn't an afterthought. It is the product. What you'll own The full … onboarding experience - a personalisation-led flow that sets expectations and directly influences trial conversion and first-order value. The A / B testing programme (built on Statsig) - design, prioritise and ship experiments that move the metrics that matter: conversion rate ...

expansion underway. This is a role for a growth PM who knows the goal isn't running A / B tests - it's conversion. Here, the funnel isn't an afterthought. It is the product. What you'll own The full … onboarding experience - a personalisation-led flow that sets expectations and directly influences trial conversion and first-order value. The A / B testing programme (built on Statsig) - design, prioritise and ship experiments that move the metrics that matter: conversion rate ...

expansion underway. This is a role for a growth PM who knows the goal isn't running A / B tests - it's conversion. Here, the funnel isn't an afterthought. It is the product. What you'll own The full … onboarding experience - a personalisation-led flow that sets expectations and directly influences trial conversion and first-order value. The A / B testing programme (built on Statsig) - design, prioritise and ship experiments that move the metrics that matter: conversion rate ...

manual effort and support scalable, end-to-end delivery. You will collaborate with cross-functional teams to validate use cases via A / B testing and ensure alignment with customer and business outcomes. You will host regular interlock sessions to review defects, share … delivery, or proactive service enablement. You will have experience leading automation and data driven fault prevention initiatives, including the use of A / B testing to validate improvements. You will have extensive experience and deep knowledge in Fixed and Mobile Network Design, Capacity ...

customers with their shopping tasks at every step of their shopping journey. This innovative role focuses on developing and optimizing language model‐powered (LLM / SLM) conversational experiences. The core emphasis is to get the best performance out of LLMs / SLMs via careful and methodical instruction design … contextual grounding, informed choices of MCP tools and agent / multi‐agent systems, context engineering, model fine‐tuning, evaluation frameworks, and experimentation to systematically improve quality, robustness, and customer impact. The work combines scientific rigor with product intuition to systematically raise the bar for conversational AI performance at Amazon ...

Responsibilities Own the full website user experience, ensuring journeys are intuitive, frictionless, and aligned to customer needs. Lead CRO activity including A / B testing, user testing, heatmaps, and behavioural analysis. Translate insights into clear recommendations that improve conversion and engagement. … teams and influencing decision-making. Manage the backlog of website improvements and prioritise based on impact. Monitor performance metrics and report on key UX / CRO outcomes. Act as the internal voice of the customer, ensuring digital decisions are insight-led. About You This role suits someone ambitious, proactive ...

design process. Work closely with the E2E IT Architect and backend teams to define, refine, and document the API contracts (RESTful / GraphQL) required to deliver flawless frontend functionality and data integration. Vendor & Partner Steering Lead and direct our external frontend development partners across all support and delivery tiers. … maintainable code. User Experience & Performance Champion a user-centric and performance-first culture. Utilize analytics, user feedback, and A / B testing to make data-driven decisions. Define and monitor Core Web Vitals and other performance metrics to ensure an exceptional ...

from concept through to launch Work with Shopify Liquid, APIs and third-party integrations Develop responsive web experiences using JavaScript, jQuery, HTML and CSS / SCSS Create intuitive and user-friendly backend environments for website administrators Utilise AI development tools to support theme creation and development workflows Support data … migration and synchronisation between Shopify and external platforms Implement website performance optimisation and best practice development standards Assist with A / B testing, SEO implementation and data-driven improvements Collaborate across multiple projects while managing priorities effectively Troubleshoot technical issues and contribute innovative ...

Support evaluation of downstream applications (including GenAI-powered features) where they depend on retrieval quality. Experimentation & Reporting Help design and lead A / B testing and experimentation frameworks for search and ranking improvements. Partner with product and data science to define success metrics … Tableau, Power BI, Looker, matplotlib, seaborn) Experience working with Databricks or similar large-scale data platforms Excellent understanding of experimentation design, A / B testing, and statistical analysis Experience defining and analyzing search / retrieval metrics (e.g., NDCG, recall, precision, ranking metrics ...

e.g., NDCG, recall, precision) LLM and RAG evaluation methodologies Grounding and faithfulness evaluation Human evaluation and annotation strategies Online experimentation and A / B testing Establish best practices for offline benchmarking, online experimentation, and reproducible evaluation workflows. Build scalable processes for benchmark creation … systems. Information retrieval and semantic search Retrieval-augmented generation (RAG) Evaluation methodologies for IR and generative AI systems Experimentation frameworks and A / B testing Strong experience with: Vector retrieval and hybrid search architectures. LLM evaluation and AI quality measurement Embeddings, reranking ...

What you’ll own Day‐to‐day ecommerce trading: product launches, homepage merch, promos & seasonal campaigns Onsite optimisation: search, journeys, CRO, A / B testing and UX fixes Commercial performance: forecasts, revenue targets, scenario planning for peak periods Analytics & reporting: daily / weekly / monthly KPIs (conversion, AOV, LTV), Google Analytics & Shopify insight CRM partnership: support acquisition, retention and personalisation strategy Brand & content: ensure consistent storytelling across digital touchpoints Platform & ops: work with dev / tech teams on Shopify enhancements, bugs and feature rollouts You’ll be brilliant ...

What you’ll own 🧭 Day‐to‐day ecommerce trading: product launches, homepage merch, promos & seasonal campaigns Onsite optimisation: search, journeys, CRO, A / B testing and UX fixes Commercial performance: forecasts, revenue targets, scenario planning for peak periods Analytics & reporting: daily / weekly / monthly KPIs (conversion, AOV, LTV), Google Analytics & Shopify insight CRM partnership: support acquisition, retention and personalisation strategy Brand & content: ensure consistent storytelling across digital touchpoints Platform & ops: work with dev / tech teams on Shopify enhancements, bugs and feature rollouts You’ll be brilliant ...

e.g., NDCG, recall, precision) LLM and RAG evaluation methodologies Grounding and faithfulness evaluation Human evaluation and annotation strategies Online experimentation and A / B testing Establish best practices for offline benchmarking, online experimentation, and reproducible evaluation workflows. Build scalable processes for benchmark creation … systems. Information retrieval and semantic search Retrieval-augmented generation (RAG) Evaluation methodologies for IR and generative AI systems Experimentation frameworks and A / B testing Strong experience with: Vector retrieval and hybrid search architectures. LLM evaluation and AI quality measurement Embeddings, reranking ...

e.g., NDCG, recall, precision) LLM and RAG evaluation methodologies Grounding and faithfulness evaluation Human evaluation and annotation strategies Online experimentation and A / B testing Establish best practices for offline benchmarking, online experimentation, and reproducible evaluation workflows. Build scalable processes for benchmark creation … systems. Information retrieval and semantic search Retrieval-augmented generation (RAG) Evaluation methodologies for IR and generative AI systems Experimentation frameworks and A / B testing Strong experience with: Vector retrieval and hybrid search architectures. LLM evaluation and AI quality measurement Embeddings, reranking ...

e.g., NDCG, recall, precision) LLM and RAG evaluation methodologies Grounding and faithfulness evaluation Human evaluation and annotation strategies Online experimentation and A / B testing Establish best practices for offline benchmarking, online experimentation, and reproducible evaluation workflows. Build scalable processes for benchmark creation … systems. Information retrieval and semantic search Retrieval-augmented generation (RAG) Evaluation methodologies for IR and generative AI systems Experimentation frameworks and A / B testing Strong experience with: Vector retrieval and hybrid search architectures. LLM evaluation and AI quality measurement Embeddings, reranking ...

design team, you will lead service design initiatives across complex digital, operational, and organisational ecosystems. You will collaborate closely with Product Design Leads, UX / UI Designers, User Researchers, Product Managers, Engineers, Data Specialists, Delivery Managers, and senior business stakeholders to identify opportunities, solve complex challenges, and shape connected … Skilled in analysing customer feedback, behavioural data, operational metrics, and performance insights to drive service improvements. Understanding of experimentation methodologies, including A / B testing and iterative optimisation approaches. Experience identifying risks, assumptions, and dependencies through structured testing and validation activities. ...

design team, you will lead service design initiatives across complex digital, operational, and organisational ecosystems. You will collaborate closely with Product Design Leads, UX / UI Designers, User Researchers, Product Managers, Engineers, Data Specialists, Delivery Managers, and senior business stakeholders to identify opportunities, solve complex challenges, and shape connected … Skilled in analysing customer feedback, behavioural data, operational metrics, and performance insights to drive service improvements. Understanding of experimentation methodologies, including A / B testing and iterative optimisation approaches. Experience identifying risks, assumptions, and dependencies through structured testing and validation activities. ...

design team, you will lead service design initiatives across complex digital, operational, and organisational ecosystems. You will collaborate closely with Product Design Leads, UX / UI Designers, User Researchers, Product Managers, Engineers, Data Specialists, Delivery Managers, and senior business stakeholders to identify opportunities, solve complex challenges, and shape connected … Skilled in analysing customer feedback, behavioural data, operational metrics, and performance insights to drive service improvements. Understanding of experimentation methodologies, including A / B testing and iterative optimisation approaches. Experience identifying risks, assumptions, and dependencies through structured testing and validation activities. ...

design team, you will lead service design initiatives across complex digital, operational, and organisational ecosystems. You will collaborate closely with Product Design Leads, UX / UI Designers, User Researchers, Product Managers, Engineers, Data Specialists, Delivery Managers, and senior business stakeholders to identify opportunities, solve complex challenges, and shape connected … Skilled in analysing customer feedback, behavioural data, operational metrics, and performance insights to drive service improvements. Understanding of experimentation methodologies, including A / B testing and iterative optimisation approaches. Experience identifying risks, assumptions, and dependencies through structured testing and validation activities. ...

direction and standards across a broad area, drive architecture and engineering excellence, and partner closely with Product, Design, Engineering Leadership and Data / Analytics to turn customer and business needs into coherent, measurable outcomes. You'll play a key role in helping teams make good … supporting services, ensuring solutions are scalable, maintainable and aligned with the broader platform direction Champion an experimentation-first approach, embedding A / B testing, measurement and iteration into the way teams build, validate and evolve experiences Raise the engineering bar across teams ...

/ CRO Specialist Glasgow - Hybrid Up to 48,000 Our client, a successful multi-brand eCommerce business is looking to add an experienced UX / CRO Specialist to their growing digital team. This is an exciting opportunity for someone who enjoys using customer insight, analytics … usability issues and conversion opportunities. Use behavioural data, analytics and customer insight to make evidence-based recommendations. Plan, support and evaluate A / B testing and optimisation programmes. Review navigation, category pages, product pages, checkout and post-purchase experiences. Measure the impact ...

decisions. Technology is at our core and innovation is everywhere. But our company is more than datasets, lines of code or A / B tests. We're the thrill of the first night in a new place. The excitement of the following morning. … directly related to the Trip Helpfulness aspect of the Connected Trip. Key Job Responsibilities and Duties: Owns and sets the vision for their product / feature, informed by data, user research and overarching vision of their product area Lays out a 1y strategy to achieve the vision ...