1 to 25 of 81 A/B Testing Jobs

Requirements / h3 ul li Bachelor's, Master’s, or PhD or equivalent experience in Computer Science, Machine Learning, Applied Mathematics, Statistics, Financial Engineering, or a related quantitative field / li , li Significant professional experience (typically 7–12+ years) in AI / ML product development … / management, model validation, quantitative research, risk modelling, or related areas / li , li Demonstrated success working with technical teams or senior specialists in high stakes modelling environments / li , li Deep understanding of AI / ML systems including LLMs, agentic architectures, RAG pipelines, credit ...

Responsibilities Own the full website user experience, ensuring journeys are intuitive, frictionless, and aligned to customer needs. Lead CRO activity including A / B testing, user testing, heatmaps, and behavioural analysis. Translate insights into clear recommendations that improve conversion and engagement. … teams and influencing decision-making. Manage the backlog of website improvements and prioritise based on impact. Monitor performance metrics and report on key UX / CRO outcomes. Act as the internal voice of the customer, ensuring digital decisions are insight-led. About You This role suits someone ambitious, proactive ...

from concept through to launch Work with Shopify Liquid, APIs and third-party integrations Develop responsive web experiences using JavaScript, jQuery, HTML and CSS / SCSS Create intuitive and user-friendly backend environments for website administrators Utilise AI development tools to support theme creation and development workflows Support data … migration and synchronisation between Shopify and external platforms Implement website performance optimisation and best practice development standards Assist with A / B testing, SEO implementation and data-driven improvements Collaborate across multiple projects while managing priorities effectively Troubleshoot technical issues and contribute innovative ...

Support evaluation of downstream applications (including GenAI-powered features) where they depend on retrieval quality. Experimentation & Reporting Help design and lead A / B testing and experimentation frameworks for search and ranking improvements. Partner with product and data science to define success metrics … Tableau, Power BI, Looker, matplotlib, seaborn) Experience working with Databricks or similar large-scale data platforms Excellent understanding of experimentation design, A / B testing, and statistical analysis Experience defining and analyzing search / retrieval metrics (e.g., NDCG, recall, precision, ranking metrics ...

e.g., NDCG, recall, precision) LLM and RAG evaluation methodologies Grounding and faithfulness evaluation Human evaluation and annotation strategies Online experimentation and A / B testing Establish best practices for offline benchmarking, online experimentation, and reproducible evaluation workflows. Build scalable processes for benchmark creation … systems. Information retrieval and semantic search Retrieval-augmented generation (RAG) Evaluation methodologies for IR and generative AI systems Experimentation frameworks and A / B testing Strong experience with: Vector retrieval and hybrid search architectures. LLM evaluation and AI quality measurement Embeddings, reranking ...

Data Analyst Location: Manchester (Hybrid: 1 day per week onsite, typically Wednesdays) Duration: August 2026 - April 2027 (Maternity Cover) Rate: £540 / day / £72 / hour (Inside IR35 / Paid via an Umbrella Company) About the Business We are a global leader … cleansing, validation, aggregation, and reporting of complex datasets to create scalable, long-term analytics solutions. Experimentation & Insight: Design, execute, and analyse A / B (and multivariate) tests to measure the success of new product features and business initiatives. Stakeholder Influence: Autonomously partner with cross-functional ...

unique opportunity to transform reporting, build behavioural analytics, and work across the whole ecosystem lifecycle. This is a hybrid role (2 / 3 days week) for 13 months with potential to extend. Responsibilities Building robust data foundations: Collaborate with engineering to develop pipelines, improve data integrity … reduce escalations. Advancing AI-native analytics: Leverage Gen AI tools to automate recurring insight generation Enabling experimentation & continuous improvement: Support A / B testing and digital experience evaluations Influencing strategy through storytelling: Communicate insights and trends clearly and persuasively to technical ...

decisions. Technology is at our core and innovation is everywhere. But our company is more than datasets, lines of code or A / B tests. We're the thrill of the first night in a new place. The excitement of the following morning. … directly related to the Trip Helpfulness aspect of the Connected Trip. Key Job Responsibilities and Duties: Owns and sets the vision for their product / feature, informed by data, user research and overarching vision of their product area Lays out a 1y strategy to achieve the vision ...

Design and deliver scalable reporting, dashboards, and data solutions Partner with cross-functional teams including Product, Engineering, and Business stakeholders Conduct A / B testing and experimentation to evaluate product and feature performance Build and maintain high-quality datasets for advanced analytics Translate … team What We're Looking For Proven experience in Data Analytics or a similar role Strong SQL skills and experience with Python / PySpark Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A / B testing ...

marketing stakeholders to optimise campaigns and improve ROI Provide insight into customer acquisition, engagement, retention and lifetime value Design and analyse A / B tests to support experimentation and performance improvement Build dashboards and enable self-serve analytics for non-technical stakeholders Collaborate with product … working with large datasets Proven experience in performance analytics within a digital environment Hands-on experience with experimentation and A / B testing Familiarity with tools such as Google Analytics or similar platforms Experience with data visualisation tools such as Looker ...

decisions. Technology is at our core. And innovation is everywhere. But our company is more than datasets, lines of code or A / B tests. We're the thrill of the first night in a new place. The excitement of the next morning. … talent in the team Foster a great culture that innovates, work together as a team, partner with other Booking.com teams / roles and celebrate unified success Respect the Booking.com values and use them as a guide to the way we work Technology, Craft ...

. What you'll be doing Own the experimentation roadmap and CRO strategy across the full customer journey Design and run A / B tests across email, website, and direct marketing channels Identify customer pain points and define optimisation opportunities Work with UX, engineering … continuous optimisation Drive a culture of data-driven experimentation across the business What you bring Must-haves Strong experience working in CRO / experimentation / optimisation roles Proven experience owning an experimentation roadmap (not just contributing) Hands-on experience running A / B ...

proactively identifying opportunities for optimisation and improvement. • Coordinate closely with HQ and global teams on platform management, site updates, CRO initiatives, A / B testing, product management, merchandising, content updates and digital marketing execution. • Maintain strong awareness of media campaigns, CRM activity … teams on platform enhancements, testing, bug fixes and feature rollouts. • Support platform management across Shopify and associated tech architecture. • Partner with SEO / GEO and CRO teams to improve site visibility, organic performance and conversion rate. • Manage, prioritise and review the workload and output of the Ecommerce ...

Product Analyst - £55,000 (Hybrid - London) Industry: Consumer Marketplace / Mobile App Department: Product & Insights We're looking for a Product Analyst to join a fast-growing consumer marketplace used by millions globally. You'll work closely with product managers, designers, and engineers to uncover … Analyse user behaviour and product performance across key journeys Build dashboards and self-serve insights for cross-functional teams Support A / B testing: design experiments, interpret results, recommend next steps Work with data and platform teams to ensure clean, scalable datasets Present ...

driven testing and optimisation. What you'll be doing: Building testing strategies and hypotheses Designing and analysing A / B and multivariate tests Delivering insights and recommendations to clients Running client meetings and stakeholder workshops Producing reports, presentations and optimisation roadmaps … What we're looking for: 4+ years' experience in CRO, experimentation or digital analytics Strong A / B testing and optimisation experience Excellent stakeholder management and communication skills Experience with tools such as Webtrends Optimize, VWO, Optimizely, AB Tasty or similar Passion ...

weight UI / UX Designer | Remote (UK ) | £55,000 - £60,000 About the Company We're partnering with a fast-growing, profitable student platform that's just closed a £7m Series A and is gearing up for a US launch. Think … micromanagement . The Role This is a new seat at the table. There has never been a dedicated UI / UX designer in the business, and the opportunity is wide open - both products need you. You'll own the end-to-end design process across ...

execution across multiple digital platforms. The Role Support the build-out of an experimentation centre of excellence Translate business OKRs into A / B testing roadmaps Own test prioritisation, ideation and execution Run experiments end-to-end (design launch analysis insight) Work closely … hands-on role - you'll need to think strategically while still being able to execute and deliver. About You Proven experience running experimentation / CRO programmes Hands-on experience building and analysing A / B tests Strong understanding of experimentation principles & metrics Experience with ...

across platforms. Evaluation & Experimentation Leadership Define and operationalise evaluation frameworks for search and generative AI systems, including IR metrics (NDCG, recall, precision) and LLM / RAG evaluation methodologies. Develop grounding and faithfulness evaluation, human evaluation, and annotation strategies. Design online experimentation and A / B … search relevance and ranking systems, semantic search, retrieval‐augmented generation, evaluation methodologies for IR and generative AI, experimentation frameworks and A / B testing. Strong experience with vector retrieval and hybrid search architectures, LLM evaluation and AI quality measurement, embeddings, reranking, and retrieval orchestration. Experience ...

globally. Collaborate with engineering teams to integrate data science models seamlessly into our tech stack. Experimentation & Insights Design and execute rigorous A / B tests to validate new features, algorithms, and product iterations. Apply advanced statistical and probability theory to evaluate model performance and user … scheme. Wellbeing: Amongst other things, enhanced maternity and paternity leave; 25 days paid holiday per year plus 8 bank holidays; 3 paid volunteer days / year; Summer hours through July and August (we finish at 4pm on a Friday); and a full programme of wellbeing ...

Centre of Excellence for experimentation across digital teams Translate business objectives and OKRs into clear experimentation roadmaps Prioritise, design and execute A / B tests across web and digital platforms Act as a hands-on experimentation specialist, not just test execution but strategic … Experience Strong experience running experimentation or CRO programmes in a digital environment Hands-on experience setting up and analysing A / B tests Solid understanding of experimentation principles, metrics and statistical concepts Experience with digital analytics and experimentation tools such as GA4, Optimizely ...

a wide range of market leading InsurTech solutions. You will join us at an exciting time as we focus increasingly on cloud / SaaS solutions, upgrading existing products to new technologies and modern UX, as well as developing brand-new applications. This role combines the strategic thinking … architects, and business stakeholders to shape the product vision, manage the backlog, and drive high‐quality delivery through modern software development practices including CI / CD, infrastructure‐as‐code, cloud-native architectures, and automated testing. This position is ideal for someone who enjoys bridging technology and business, has strong ...

Digital Analyst - Retail Media & CRM (Contract) London (Hybrid) £500-£550 per day (Inside IR35) 6 Months We're hiring a Senior Analyst to join a growing Analytics & Data Science team, supporting a high-impact Retail Media function . This role is focused on leveraging … Strong Retail Media experience (ESSENTIAL) - including audience targeting, activation and performance measurement Advanced SQL plus experience with Python or R Proven experience in CRM / marketing analytics and campaign optimisation Strong understanding of statistical analysis (A / B testing, hypothesis testing ...

Location London onsite or hybrid depending on studio. Some teams also offer the option to work part of the year from a Tokyo or New York Offices. Job type Full time permanent, with some studios offering a 12 month fixed term contract subject to renewal Salary … Typically £50,000 to £60,000 per year depending on experience Role overview We are looking for a technically strong Unity Developer who enjoys building games that feel great to play and can move fast without breaking quality. This role blends rapid prototyping and iteration with solid engineering ...

Manager £50,000 - £60,000 This is an opportunity to take ownership of end-to-end customer experience and conversion strategy within a fast-paced, data-driven organisation. You will play a key role in shaping how digital journeys perform, using experimentation and insight to deliver … driven CRO and experimentation roadmap Use analytics, user behaviour data, and testing insights to identify opportunities for improvement Manage A / B testing and experimentation programmes to validate and scale changes Collaborate with product, engineering, UX, and marketing teams to deliver ...

Manager £50,000 - £60,000 This is an opportunity to take ownership of end-to-end customer experience and conversion strategy within a fast-paced, data-driven organisation. You will play a key role in shaping how digital journeys perform, using experimentation and insight to deliver … driven CRO and experimentation roadmap Use analytics, user behaviour data, and testing insights to identify opportunities for improvement Manage A / B testing and experimentation programmes to validate and scale changes Collaborate with product, engineering, UX, and marketing teams to deliver ...