1 to 25 of 535 A/B Testing Jobs

Role : Product Manager - A / B Testing Location : San Francisco CA (100% Onsite) Full Time Description Kforce has a client in San Francisco, CA that is seeking a Product Manager - A / B Testing. Summary: The Product Manager, A / B Testing, will conceptualize, design, and deliver digital A / B testing strategies designed to improve site performance and the relevancy of our on-site experience to customers. This person will define both the long-term roadmap and manage day to day strategy and execution of our A / B testing efforts with significant opportunities to drive positive KPI growth. Responsibilities: • Lead the definition, prioritization and scoping of test experiences for engineering team • Craft business requirements and user stories and to support our testing engineering teams through solution design, development, QA, and implementation phases of delivery • Ensure each test More ❯

Job Title: Senior Digital Analyst Salary: Up to £60,000 + Excellent Benefits Package Location: Huddersfield (Hybrid) Key Skills: Reporting, GA4, A / B Testing Summary A new role has opened up for a Senior Digital Analyst with PowerBI / Looker, GA4 and experience with A / B Testing to join a media-focused business. The role has opened up as the company are heavily investing, and have exciting plans for their data team. This a permanent position being offered on a hybrid basis with 3 days onsite from their Huddersfield office. The … responsibilities will cover: Build dashboards and reports Use Excel for advanced formulas, pivot tables and data validation Create a test and learn framework using A / B testing methodologies Collaborate with the marketing team to define reporting frameworks Use data insights to support forecasts and budgets Familiarity with marketing tools and More ❯

the end-to-end Fiber Internet product for Brightspeed, defining the vision, roadmap, and in-market performance for speed tiers (e.g., 1G, 2G+, 5G, 8G), equipment (Wi-Fi 7 / CPE), value-added services, and the customer experience across Join, Get / Install, Enjoy (Use / Pay / Change), and Help / Leave journeys. You … home performance, and seamless experiences across digital and assisted channels. SCOPE: Fiber product portfolio and tiering (1G, 2G+, 5G, 8G), eligibility rules, packaging, and disclosures CPE strategy (ONTs, gateways / Wi-Fi 7, extenders) and in-home performance standards Voice over Fiber / postpaid voice packaging and readiness (as applicable) VAS bundles (security, whole-home Wi-Fi, entertainment … / content, tech support) Channel readiness and plan-change flows across Digital / E-commerce, telesales, D2D, MDU / leasing, and retail / indirect Regulatory / compliance guardrails and affordability programs (as applicable) Close collaboration with E-commerce and Call Center Operations to orchestrate changes, protect CX, and optimize conversion As a Fiber More ❯

our customers love by driving user research, gathering product requirements, implementing, testing and deploying our software products features. You will work closely with the design, engineering, growth / marketing, compliance, legal and other related teams to define and execute the next important thing to work on. As the SPM in Retention team, you will be responsible for … fast pace and an agile mindset. Be detail oriented and ensure the solution delivered is in line with the product requirements and the designs. Usability & A / B Testing Usability Tests - Design and execute appropriate usability tests for a product or feature when needed. A / B Tests - Release A / B tests to measure success of the product changes and iterate if needed. Results - Collate, analyse and report on findings to key stakeholders. Stakeholder collaboration Work closely with other internal teams such as Growth / Marketing, Customer Support, Security, Tech, Central systems, Compliance, Operations etc. to make the More ❯

at Chambers, developing scalable solutions that push our technology forward and transform how we deliver value to our users. Main Duties and Responsibilities Build robust ingestion pipelines for PDFs / Word / Excel / Audio / JSON and semi structured sources. Design RAG systems: chunking strategies, document schemas, metadata, hybrid / dense retrieval, re ranking … and grounding. Manage vector / keyword indexes (e.g., Azure AI Search, pgvector, Pinecone / Weaviate). Develop and deploy advanced NLP, information retrieval, and recommendation systems that enhance Chambers and Partners' research and product offerings, including document understanding, automatic summarisation, topic modelling, semantic search, entity recognition, and relationship extraction. Design and implement intelligent tagging and metadata enrichment frameworks … market data, improving search, discoverability, and insight accuracy. LLM & Machine Learning Application Engineering Design, build and maintain traditional ML and LLM models and pipelines. Build LLM apps using LangGraph / LangChain: tools / function calling, structured outputs (JSON Schema), agents, and multi step reasoning. Implement ASR / TTS and multimodal where relevant (e.g., Whisper). Choose customization More ❯

not only visually appealing but also functional, scalable, accessible, and aligned with our brand identity. You will collaborate with design, marketing, and product teams to implement A / B testing results, improve web accessibility, and create scalable, responsive, and repeatable design systems. Key Responsibilities: Webflow Development: Build, maintain, and optimize web pages using … and performance goals. Responsive Design: Develop and optimize web experiences for a variety of devices and screen sizes, ensuring consistency and usability across platforms. A / B Testing Implementation: Work with the marketing and analytics teams to integrate A / B testing results into … strong portfolio demonstrating expertise in Webflow. Proficiency in HTML, CSS, and JavaScript, with a deep understanding of responsive design principles. Experience implementing A / B testing results into production environments. Strong knowledge of web accessibility standards (e.g., WCAG 2.1) and experience creating accessible web solutions. Ability to create scalable More ❯

a broad spectrum of state-of-the-art machine learning and deep learning technologies in the areas of recommendation systems. Create metrics and design A / B test plans to evaluate model performance offline and online to inform and convey our impacts to diverse groups of stakeholders. Collaborate with cross-functional teams of … according to standard methodologies in Python. Note: This item has been converted to bold text for emphasis where appropriate in this refined version. You Bring: Masters degree in CS / Statistics / Data Science, with a specialization in machine learning. Experience with Python, and ideally also Scala or Java. Experience in developing ML models for structured … with Machine learning frameworks such as Tensorflow, PyTorch, Spark MLlib. Industry experience in designing and implementing large-scale machine learning-based recommender systems. Industry experience in A / B testing, experimentation design and test analysis. Strong coding, machine learning, and statistical knowledge. Preferred Qualifications: Experience with Databricks, Snowflake, Spark, Tecton, Kubernetes, Helm, Jenkins. More ❯

be doing Partner with teams throughout Discord through the full lifecycle of data science analytics from ideation and exploratory analysis, to building dashboards and reports, and A / B testing Define KPIs and metrics that help improve the user experience, encapsulating these measures in clean crisp dashboards that provide the company with timely … and processes Proactively socialize insights, dashboards, and reports with technical and non-technical audiences, soliciting feedback on where to improve Be a champion of A / B testing and help groups throughout the company design, analyze, and interpret A / B tests correctly Collaborate with data … with the ability to translate complicated findings or technical approaches in easy-to-understand ways 4+ years of experience in the design, analysis, and interpretation of A / B tests in a large data environment A desire to work with amazing, passionate people who care deeply about solving challenging problems to More ❯

and revenue. You'll be responsible for building and deploying intelligent systems across several high-leverage areas: product personalization and recommendations , and a scalable A / B testing platform . This is a hands-on, highly collaborative role with direct influence over product direction and growth. You'll work … deploy ML models for product personalization and recommendations Build dynamic pricing and bidding algorithms to optimize conversion and margin Architect and maintain a scalable A / B testing and experimentation platform Collaborate on data and insights to support brand partnerships and growth efforts Own the full model lifecycle - from prototype to … ML libraries like scikit-learn, XGBoost, PyTorch, or TensorFlow Experience with embeddings , recommender systems , ranking models Familiarity with experimentation design and statistical testing (e.g., A / B testing) Comfort working cross-functionally in a fast-paced, early-stage environment Bonus: ability to translate model performance into clear business and More ❯

time and at high quality. You champion a culture of iteration - launching fast, testing rigorously, and refining continuously. You use analytics and A / B testing - to measure product impact and guide decision-making. You manage backlog and feature prioritisation with discipline - ensuring delivery efficiency. You share progress, risks … You have 5+ years of product management experience - with a track record of shipping successful mobile apps. You're highly skilled in using analytics -, A / B testing, and experimentation to inform decisions. You've worked on interactive apps - ideally in music, gaming, or education technology. You understand agile methodologies - and … leadership. Your Impact You'll know you're succeeding when: Key Learn App features are launched iteratively - based on data and user insight. Analytics frameworks and A / B testing processes are established - and embedded in workflows. Engagement, retention, and subscription metrics - show measurable improvement. You're recognised as a trusted More ❯

quickly, make decisions with creators in mind, and aren't afraid to challenge conventions when it improves the product. The Role We're looking for a Senior / Lead Data Analyst to own the quality of the video data that powers Medal's machine learning features. You'll partner closely with ML researchers, data engineering, and product … you get excited about building feedback loops that make ML systems smarter-this is for you. You Will Own the video data quality program : define quality KPIs (coverage, precision / recall, calibration, temporal alignment, label latency, drift) and build dashboards that make them visible company-wide. Audit datasets at scale using SQL and Python: create automated checks for codec … / bitrate / fps / resolution, audio / video sync, corruption, duplicates, and long-tail coverage by game, device, and region. Design ground-truth pipelines : human-in-the-loop reviews and labeling guidelines; measure annotator agreement, and iterate to improve label quality. Diagnose model-data issues : collaborate with ML to localize failure modes, quantify data gaps More ❯

Optimization will own two key areas within Product, supporting our suite of released features and the successful optimisation of them through our in house experimentation and A / B testing capabilities. Reporting directly to our CPO, you'll be first line support to our business teams for our 150+ production features and will … and feature focused product managers to ensure alignment across maintenance and innovation efforts. Data Driven Optimization Enablement Lead adoption and enablement of our evolving experimentation and A / B testing platform, ensuring business teams have the knowledge, skills, and support to utilise it fully and effectively. Partner with business teams to design, launch … company. Deep expertise in desktop display advertising. Strong analytical skills with demonstrated success in data driven revenue optimisation of advertising products, including via an experimentation or A / B testing system. Expert knowledge of programmatic advertising concepts: header bidding, auction dynamics, bid flooring, traffic shaping. Experience with consent management technologies (GPP, TCF, CCPA More ❯

Experimentation / CRO Analyst Agency - Travel Client £325-£400 per day outside IR35 London We're working with a leading digital agency to support one of their flagship travel clients, and they're looking for a hands-on Experimentation Analyst to join the team. You'll be embedded within a busy product environment … helping multiple teams design, validate, and analyse A / B and multivariate tests. You will support on the experimentation programme, ensuring every test is statistically sound, well interpreted, and actionable. Role & Responsibilities Partnering with product teams to plan and analyse A / B and MVT tests across key digital journeys. … queries and supporting experimentation best practice across the business. Collaborating with teams using Optimizely, ContentSquare, and GA4 to extract meaningful insights. Skills & Experience Proven experience analysing A / B and MVT tests in large-scale, high-traffic environments (e.g. travel, retail, eCommerce). Strong understanding of test design, sample sizing, and statistical significance. Confident advising More ❯

data science, user research, UX, competitor analysis and consumer psychology to develop data-led approaches that help our clients make their websites more successful. We use A / B and multi-variant testing to understand the impact of our recommendations, and you will work collaboratively with internal and external teams to ensure the … leadership within the team and help to develop internal processes and more junior colleagues. The latter of these may be in a direct line management capacity and / or through coaching members of the client teams you lead. Key Responsibilities and Duties: Working within the development and project team to provide technical development skills for Adobe Campaign … marketing requirements and translation into Adobe Campaign technical solutions Architect, configure, administer, and operate CRM systems Work with client stakeholders to understand requirements and translation into technical solutions Qualifications / Requirements: Previous experience with A / B testing programs (and any associated software Target, Optimize, Optimizely, VWO etc.) Previous experience with Web More ❯

enhancements across areas such as content, merchandising, and ranking in upper funnel. The ideal candidate has a proven track record in digital optimization, and A / B testing, with the ability to translate data into hypotheses and behavioural insights that drive results. You will work closely with cross-functional stakeholders across … deeper understanding of the consumer journey by constantly tracking key KPIs and analyzing behavioral data to identify opportunities and actions that improve digital performance (e.g., Site to PLP / PDP rate, add-to-cart rate, conversion rate). Shape and manage the experimentation roadmap in line with commercial, trading and consumer priorities, ensuring test outcomes are translated into … impactful actions and scalable solutions. Support the A / B testing and personalization strategy across upper-funnel experiences (Header Navigation & Onsite Search), managing test ideation, execution and performance. Deliver upper-funnel experiences that reflect seasonal campaigns, category and brand storytelling, connecting consumers with relevant products and narratives. Partner with cross-functional teams (Analytics More ❯

KPIs and surface opportunities for operational excellence. Change & test partner: Play a key role in planning, testing, and evaluating service improvements-supporting A / B testing and adopting statistical approaches to measure real-world impact. Stakeholder collaboration: Translate complex analysis into clear business value, acting as the primary expert … KPIs and surface opportunities for operational excellence. Change & test partner: Play a key role in planning, testing, and evaluating service improvements-supporting A / B testing and adopting statistical approaches to measure real-world impact. Stakeholder collaboration: Translate complex analysis into clear business value, acting as the primary expert … Outstanding communicator: able to translate complex analyses into actionable insights for both technical and non-technical audiences; confident presenting to senior management Comfortable designing and interpreting A / B tests or other statistical approaches relevant to service improvement Self-sufficient and proactive: works independently, asks the right questions, and takes full ownership of projects and More ❯

experience with experimentation, and curiosity to uncover insights that shape product strategy. You should be comfortable working with SQL and R or Python, designing and analyzing A / B tests, and translating data into actionable recommendations for product teams. Please note that this is a hybrid role that requires 3 days / … office. Fully remote candidates will not be considered at this time. What You'll Do Partner with product and engineering teams to evaluate product opportunities through A / B testing, data analysis, and customer insights Contribute to the design, implementation, and analysis of experiments - ensuring correct setup, sufficient power, and clear interpretation of … Science, Economics, or Engineering You are proficient in SQL and have experience using either Python or R for data analysis You have hands-on experience with A / B testing and statistical analysis, and are motivated to grow into more advanced methods over time You bring strong business intuition and curiosity, and can More ❯

Tableau, Looker Studio, Adobe Analytics, and similar tools tailored to various audiences, from executive leadership to marketing campaign managers Fuel experimentation & personalization: Partner closely with the A / B testing and personalization teams to formulate hypotheses, design measurement frameworks, and conduct post-test analysis to determine the business impact of our initiatives Apply … at least one enterprise-level web analytics platform (e.g., Adobe Analytics, Google Analytics 4, etc.) in a very high web traffic environment Experience with A / B / n testing methodologies and statistical significance. Experience with data warehouses like BigQuery, Snowflake or similar Proficiency in SQL for querying complex, large … gender expression, sexual orientation, national origin, ancestry, citizenship, age, physical or mental disability, medical condition, family care status, or any other basis protected by law. We are an AA / Veterans / Disabled Employer. Cloudflare provides reasonable accommodations to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a More ❯

developing scalable solutions that push our technology forward and transform how we deliver value to our users. Main Duties and Responsibilities Data & Retrieval Build robust ingestion pipelines for PDFs / Word / Excel / Audio / JSON and semi-structured sources. Design RAG systems: chunking strategies, document schemas, metadata, hybrid / dense retrieval, re-ranking … and grounding. Manage vector / keyword indexes (e.g., Azure AI Search, pgvector, Pinecone / Weaviate). Develop and deploy advanced NLP, information retrieval, and recommendation systems that enhance Chambers and Partners’ research and product offerings, including document understanding, automatic summarisation, topic modelling, semantic search, entity recognition, and relationship extraction. Design and implement intelligent tagging and metadata enrichment frameworks … market data, improving search, discoverability, and insight accuracy. LLM & Machine Learning Application Engineering Design, build, and maintain traditional ML and LLM models and pipelines. Build LLM apps using LangGraph / LangChain: tools / function calling, structured outputs (JSON Schema), agents, and multi-step reasoning. Implement ASR / TTS and multimodal where relevant (e.g., Whisper). Choose customization More ❯

as well as the front-end journeys that enable them. It includes design, engineering, data, and product. The stakeholder groups outside of our team include strategic growth, marketing, viewing / content, customer care, and more. About the Role: As a Product Manager on the Commerce "Upgrade and Churn" Product team, you will conceive, define, design, develop, test … profitability goals; being able to effectively communicate your ideas to different audiences and influence them to understand your vision. Active, ongoing experimentation on production experiences, continually a / b testing to fine-tune our product journeys and learn. Working with Legal to understand compliance requirements and propose product solutions that meet the needs. … Experience developing and shipping products for the web, mobile apps, smart TVs, connected TV devices - tvOS, Fire TV, Roku, etc. Expertise in product experimentation- design, analytics, A / B testing, user testing, and market research. Comfort working with team members across UX design, data, engineering, and stakeholder groups. Proficiency with tools More ❯

problem framing, hypothesis design, feature strategy, model development, validation, deployment planning, and impact measurement. Build audience and engagement models using multi-source viewership and behavioral signals (e.g., forecasting, churn / retention, cross-platform attribution, time-series and panel-based analysis). Develop content intelligence with NLP: taxonomy / labeling, semantic similarity, topic and entity modeling, summarization, quality / relevance scoring, content-to-audience matching, and trend detection. Create sales and advertising analytics: demand forecasting, pricing / revenue optimization, propensity and uplift modeling, inventory allocation, and campaign effectiveness measurement. Design interpretable measurement frameworks: incrementality tests, controlled experiments, uplift / A / B testing, holdouts, and causal inference for content … and ads. Unify cross-platform metrics to produce holistic funnels and KPIs; define leading indicators and build early-warning / nowcasting approaches for performance health. Engineer robust features from logs, sessions, sequences, and text; handle seasonality, cold start, sparsity, and platform-specific biases. Establish model governance: backtesting, stability monitoring, drift detection, fairness and bias assessment, and clear documentation of More ❯

re committed to expanding our reach and impact, offering you the opportunity to be part of our exciting journey. As a Director of Paid Acquisition & Growth (m / f / d) at FORMEL SKIN, you will take full ownership of our acquisition engine and lead the next phase of growth. In this role, you'll drive … Optimization (CRO): Build and run a structured CRO roadmap. Own experimentation across the website and user funnel to systematically increase conversion rates. Lead on A / B testing and work closely with Product and Design. Go to Market: Develop and execute acquisition strategies for launching new products and markets. Ensure fast … acquisition channels (e.g., Google, Meta, TikTok), with a track record of managing 7 figure budgets effectively. CRO & Experimentation Skills: Strong background in conversion optimisation, A / B testing, and funnel performance analytics. GTM Execution: Experience launching products in new markets or segments, with strong strategic and operational capabilities. MarTech & Automation: Hands More ❯

the differentiation of Constructor to prospects will be critical. Our next Solutions Architect is well-versed in enterprise eCommerce and has experience with Cloud technologies, data science and analytics / testing principles, SaaS, solution design, software development methodology, security requirements, SaaS architectures, and enterprise integrations. You are comfortable presenting to prospects and partners to showcase Constructor's … solutions that comprise retailer technology stacks Ability to comprehend complex data structures and prescribe best practices to optimize them Familiarity with data science and statistics principles, A / B testing methodologies and analytics Ability to explain AI and Machine Learning concepts to both technical and non-technical audiences This role is ideal for … agents. Engineering is by far our largest department, and we've built our proprietary engine to be the best on the market, having never lost an A / B test to a competitive technology. We're passionate about maintaining this and work on the bleeding edge of AI to do so. Out of More ❯

D2C business. Private Equity backed As the Website Manager, you’ll be instrumental in shaping the launch and growth of a new website, supporting A / B testing and conversion rate optimisation, while leading ongoing enhancements to user experience, site performance, and content effectiveness. Key Responsibilities: Manage the daily operation and … website metrics. Regularly update website content, resolve bugs. Identify improvements to UX, UI, and on-site content for better engagement and performance. Plan, execute, and analyse A / B and multivariate tests to support data-driven decisions. Track and optimise site speed, uptime, and overall technical performance. Lead the planning, development, and implementation of a … fast-moving B2C or multi-site organisation. Strong experience working with CMS platforms, particularly WordPress and HubSpot. Hands-on experience with CRO strategies and A / B testing tools. Proficiency with web analytics and performance tracking systems. Solid understanding of HTML, CSS, and basic JavaScript. In-depth knowledge of SEO best More ❯

AOV. Roadmap Prioritization & Execution: Support the creation of the product vision, goals, and roadmap and manage a dynamic and evolving product backlog, prioritizing and A / B testing new ideas. This may mean: synthesizing new feature requests, working with site merchandisers to drive improvements to our content management system, partnering with … competitive analysis, evaluate other retailers, and stay informed on the industry and evolving technologies in this space. About You: 5-7+ years experience in a B2C / DTC ecommerce environment, preferably running Shopify stores 5-7+ years of product management, project management, and / or digital experience Analytical with a test-and … Shopify Plus, Commerce Cloud, etc. Experience with Web Analytics tools e.g. GA4, Heap, Fullstory, etc. Experience with Content Management Systems e.g., Sanity, Contentful, etc. Experience with A / B Testing Options e.g., Server Side, Optimizely, etc. Experience with Google Tag Manager and third party data platforms Benefits We Offer: Competitive salary, stock options More ❯