1 to 25 of 441 A/B Testing Jobs

Job Title: Product Manager - A / B Testing Location: San Francisco, CA Duration: Long-term Rate : $50 to $55 / hr on W2 Job Description Product Manager - A / B Testing. Summary: The Product Manager, A / B Testing, will … conceptualize, design, and deliver digital A / B testing strategies designed to improve site performance and the relevancy of our on-site experience to customers. This person will define both the long-term roadmap and manage day to day strategy and execution of our A / B testing … on testing opportunities to maintain a full pipeline of experiments for engineering Create and execute test campaigns using Adobe Target and homegrown A / B testing solution, including audience creation, enlisting IT development resources for more complicated functional test treatments Work with the rest of the Product Analytics & Experimentation More ❯

Job Title: Senior Digital Analyst Salary: Up to £60,000 + Excellent Benefits Package Location: Huddersfield (Hybrid) Key Skills: Reporting, GA4, A / B Testing Summary A new role has opened up for a Senior Digital Analyst with PowerBI / Looker, GA4 and experience with A / B Testing to join a media-focused business. The role has opened up as the company are heavily investing, and have exciting plans for their data team. This a permanent position being offered on a hybrid basis with 3 days onsite from their Huddersfield office. The … responsibilities will cover: Build dashboards and reports Use Excel for advanced formulas, pivot tables and data validation Create a test and learn framework using A / B testing methodologies Collaborate with the marketing team to define reporting frameworks Use data insights to support forecasts and budgets Familiarity with marketing tools and More ❯

the end-to-end Fiber Internet product for Brightspeed, defining the vision, roadmap, and in-market performance for speed tiers (e.g., 1G, 2G+, 5G, 8G), equipment (Wi-Fi 7 / CPE), value-added services, and the customer experience across Join, Get / Install, Enjoy (Use / Pay / Change), and Help / Leave journeys. You … home performance, and seamless experiences across digital and assisted channels. SCOPE: Fiber product portfolio and tiering (1G, 2G+, 5G, 8G), eligibility rules, packaging, and disclosures CPE strategy (ONTs, gateways / Wi-Fi 7, extenders) and in-home performance standards Voice over Fiber / postpaid voice packaging and readiness (as applicable) VAS bundles (security, whole-home Wi-Fi, entertainment … / content, tech support) Channel readiness and plan-change flows across Digital / E-commerce, telesales, D2D, MDU / leasing, and retail / indirect Regulatory / compliance guardrails and affordability programs (as applicable) Close collaboration with E-commerce and Call Center Operations to orchestrate changes, protect CX, and optimize conversion As a Fiber More ❯

our customers love by driving user research, gathering product requirements, implementing, testing and deploying our software products features. You will work closely with the design, engineering, growth / marketing, compliance, legal and other related teams to define and execute the next important thing to work on. As the SPM in Retention team, you will be responsible for … fast pace and an agile mindset. Be detail oriented and ensure the solution delivered is in line with the product requirements and the designs. Usability & A / B Testing Usability Tests - Design and execute appropriate usability tests for a product or feature when needed. A / B Tests - Release A / B tests to measure success of the product changes and iterate if needed. Results - Collate, analyse and report on findings to key stakeholders. Stakeholder collaboration Work closely with other internal teams such as Growth / Marketing, Customer Support, Security, Tech, Central systems, Compliance, Operations etc. to make the More ❯

at Chambers, developing scalable solutions that push our technology forward and transform how we deliver value to our users. Main Duties and Responsibilities Build robust ingestion pipelines for PDFs / Word / Excel / Audio / JSON and semi structured sources. Design RAG systems: chunking strategies, document schemas, metadata, hybrid / dense retrieval, re ranking … and grounding. Manage vector / keyword indexes (e.g., Azure AI Search, pgvector, Pinecone / Weaviate). Develop and deploy advanced NLP, information retrieval, and recommendation systems that enhance Chambers and Partners' research and product offerings, including document understanding, automatic summarisation, topic modelling, semantic search, entity recognition, and relationship extraction. Design and implement intelligent tagging and metadata enrichment frameworks … market data, improving search, discoverability, and insight accuracy. LLM & Machine Learning Application Engineering Design, build and maintain traditional ML and LLM models and pipelines. Build LLM apps using LangGraph / LangChain: tools / function calling, structured outputs (JSON Schema), agents, and multi step reasoning. Implement ASR / TTS and multimodal where relevant (e.g., Whisper). Choose customization More ❯

a broad spectrum of state-of-the-art machine learning and deep learning technologies in the areas of recommendation systems. Create metrics and design A / B test plans to evaluate model performance offline and online to inform and convey our impacts to diverse groups of stakeholders. Collaborate with cross-functional teams of … according to standard methodologies in Python. Note: This item has been converted to bold text for emphasis where appropriate in this refined version. You Bring: Masters degree in CS / Statistics / Data Science, with a specialization in machine learning. Experience with Python, and ideally also Scala or Java. Experience in developing ML models for structured … with Machine learning frameworks such as Tensorflow, PyTorch, Spark MLlib. Industry experience in designing and implementing large-scale machine learning-based recommender systems. Industry experience in A / B testing, experimentation design and test analysis. Strong coding, machine learning, and statistical knowledge. Preferred Qualifications: Experience with Databricks, Snowflake, Spark, Tecton, Kubernetes, Helm, Jenkins. More ❯

ll be doing Partner with teams throughout Discord through the full lifecycle of data science from ideation and exploratory analysis, to building dashboards and reports, and A / B testing Define KPIs and diagnostic metrics that help improve the user experience, encapsulating these measures in clean crisp dashboards that provide the company with … and processes Proactively socialize insights, dashboards, and reports with technical and non-technical audiences, soliciting feedback on where to improve Be a champion of A / B testing and help groups throughout the company design, analyze, and interpret A / B tests correctly Collaborate with data … in designing clean crisp visualizations 6+ years experience writing robust, efficient and performant SQL 4+ years of experience in the design, analysis, and interpretation of sound A / B tests in a fast-paced environment at scale Experience with technical leadership, being the point person for one or more stakeholder groups Excellent communication More ❯

and revenue. You'll be responsible for building and deploying intelligent systems across several high-leverage areas: product personalization and recommendations , and a scalable A / B testing platform . This is a hands-on, highly collaborative role with direct influence over product direction and growth. You'll work … deploy ML models for product personalization and recommendations Build dynamic pricing and bidding algorithms to optimize conversion and margin Architect and maintain a scalable A / B testing and experimentation platform Collaborate on data and insights to support brand partnerships and growth efforts Own the full model lifecycle - from prototype to … ML libraries like scikit-learn, XGBoost, PyTorch, or TensorFlow Experience with embeddings , recommender systems , ranking models Familiarity with experimentation design and statistical testing (e.g., A / B testing) Comfort working cross-functionally in a fast-paced, early-stage environment Bonus: ability to translate model performance into clear business and More ❯

time and at high quality. You champion a culture of iteration - launching fast, testing rigorously, and refining continuously. You use analytics and A / B testing - to measure product impact and guide decision-making. You manage backlog and feature prioritisation with discipline - ensuring delivery efficiency. You share progress, risks … You have 5+ years of product management experience - with a track record of shipping successful mobile apps. You're highly skilled in using analytics -, A / B testing, and experimentation to inform decisions. You've worked on interactive apps - ideally in music, gaming, or education technology. You understand agile methodologies - and … leadership. Your Impact You'll know you're succeeding when: Key Learn App features are launched iteratively - based on data and user insight. Analytics frameworks and A / B testing processes are established - and embedded in workflows. Engagement, retention, and subscription metrics - show measurable improvement. You're recognised as a trusted More ❯

our understanding of Customers. Our focus is on Coupang's ads business on Ecommerce, and we do this by analyzing KPI's, analyzing the success of A / B and multivariate testing initiatives. What You Will Do As a Staff Data Scientist at Coupang Ads, you will be responsible for - Product … revenue forecasting models as a critical component of the revenue optimization process. Assist with analyzing sales patterns to identify trends and aid financial forecasting A / B Testing : design, conduct, analyze and uncover insights from A / B tests to inform and prioritize product iterations. Do … years of experience as a data scientist performing ads data analysis, ML model building and optimization, financial analysis, market research, and executive reporting. Previous experience in AdTech / Advertising (search, display, branding, retargeting, social, streaming video ), Digital Marketing, Ad Agency, or related domains. Strong SQL Python or R for statistical analysis Hive, Presto, Airflow Experience with ML More ❯

Experimentation / CRO Analyst Agency - Travel Client £325-£400 per day outside IR35 London We're working with a leading digital agency to support one of their flagship travel clients, and they're looking for a hands-on Experimentation Analyst to join the team. You'll be embedded within a busy product environment … helping multiple teams design, validate, and analyse A / B and multivariate tests. You will support on the experimentation programme, ensuring every test is statistically sound, well interpreted, and actionable. Role & Responsibilities Partnering with product teams to plan and analyse A / B and MVT tests across key digital journeys. … queries and supporting experimentation best practice across the business. Collaborating with teams using Optimizely, ContentSquare, and GA4 to extract meaningful insights. Skills & Experience Proven experience analysing A / B and MVT tests in large-scale, high-traffic environments (e.g. travel, retail, eCommerce). Strong understanding of test design, sample sizing, and statistical significance. Confident advising More ❯

data science, user research, UX, competitor analysis and consumer psychology to develop data-led approaches that help our clients make their websites more successful. We use A / B and multi-variant testing to understand the impact of our recommendations, and you will work collaboratively with internal and external teams to ensure the … leadership within the team and help to develop internal processes and more junior colleagues. The latter of these may be in a direct line management capacity and / or through coaching members of the client teams you lead. Key Responsibilities and Duties: Working within the development and project team to provide technical development skills for Adobe Campaign … marketing requirements and translation into Adobe Campaign technical solutions Architect, configure, administer, and operate CRM systems Work with client stakeholders to understand requirements and translation into technical solutions Qualifications / Requirements: Previous experience with A / B testing programs (and any associated software Target, Optimize, Optimizely, VWO etc.) Previous experience with Web More ❯

identify friction, define improvements, and deliver best-in-class digital journeys. You will lead two experienced managers, overseeing optimisation, site features, internal search, journey enhancements, and A / B testing - supported by a wider network of analysts, UX designers, and engineering teams. The digital product organisation is structured into four customer … site performance. You will play a central role in ideation, requirements gathering, testing, UAT, and post-launch validation - partnering with Tech, Product, UX, and global / regional stakeholders to bring enhancements to life. Key responsibilities include: Customer Journey & Optimisation Own end-to-end CX for selected digital product areas. Identify friction points and champion solutions … with Product / Tech teams. Ensure site functionality, features, and promotional components perform as intended. Represent the business throughout discovery, design reviews, and release cycles. Data & Voice of Customer Analyse NPS, qualitative feedback, and digital metrics to surface issues and opportunities. Deliver clear, data-led insights on customer impact and commercial performance. Collaborate with analytics to influence content, merchandising More ❯

experience with experimentation, and curiosity to uncover insights that shape product strategy. You should be comfortable working with SQL and R or Python, designing and analyzing A / B tests, and translating data into actionable recommendations for product teams. Please note that this is a hybrid role that requires 3 days / … office. Fully remote candidates will not be considered at this time. What You'll Do Partner with product and engineering teams to evaluate product opportunities through A / B testing, data analysis, and customer insights Contribute to the design, implementation, and analysis of experiments - ensuring correct setup, sufficient power, and clear interpretation of … Science, Economics, or Engineering You are proficient in SQL and have experience using either Python or R for data analysis You have hands-on experience with A / B testing and statistical analysis, and are motivated to grow into more advanced methods over time You bring strong business intuition and curiosity, and can More ❯

Tableau, Looker Studio, Adobe Analytics, and similar tools tailored to various audiences, from executive leadership to marketing campaign managers Fuel experimentation & personalization: Partner closely with the A / B testing and personalization teams to formulate hypotheses, design measurement frameworks, and conduct post-test analysis to determine the business impact of our initiatives Apply … at least one enterprise-level web analytics platform (e.g., Adobe Analytics, Google Analytics 4, etc.) in a very high web traffic environment Experience with A / B / n testing methodologies and statistical significance. Experience with data warehouses like BigQuery, Snowflake or similar Proficiency in SQL for querying complex, large … gender expression, sexual orientation, national origin, ancestry, citizenship, age, physical or mental disability, medical condition, family care status, or any other basis protected by law. We are an AA / Veterans / Disabled Employer. Cloudflare provides reasonable accommodations to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a More ❯

developing scalable solutions that push our technology forward and transform how we deliver value to our users. Main Duties and Responsibilities Data & Retrieval Build robust ingestion pipelines for PDFs / Word / Excel / Audio / JSON and semi-structured sources. Design RAG systems: chunking strategies, document schemas, metadata, hybrid / dense retrieval, re-ranking … and grounding. Manage vector / keyword indexes (e.g., Azure AI Search, pgvector, Pinecone / Weaviate). Develop and deploy advanced NLP, information retrieval, and recommendation systems that enhance Chambers and Partners’ research and product offerings, including document understanding, automatic summarisation, topic modelling, semantic search, entity recognition, and relationship extraction. Design and implement intelligent tagging and metadata enrichment frameworks … market data, improving search, discoverability, and insight accuracy. LLM & Machine Learning Application Engineering Design, build, and maintain traditional ML and LLM models and pipelines. Build LLM apps using LangGraph / LangChain: tools / function calling, structured outputs (JSON Schema), agents, and multi-step reasoning. Implement ASR / TTS and multimodal where relevant (e.g., Whisper). Choose customization More ❯

problem framing, hypothesis design, feature strategy, model development, validation, deployment planning, and impact measurement. Build audience and engagement models using multi-source viewership and behavioral signals (e.g., forecasting, churn / retention, cross-platform attribution, time-series and panel-based analysis). Develop content intelligence with NLP: taxonomy / labeling, semantic similarity, topic and entity modeling, summarization, quality / relevance scoring, content-to-audience matching, and trend detection. Create sales and advertising analytics: demand forecasting, pricing / revenue optimization, propensity and uplift modeling, inventory allocation, and campaign effectiveness measurement. Design interpretable measurement frameworks: incrementality tests, controlled experiments, uplift / A / B testing, holdouts, and causal inference for content … and ads. Unify cross-platform metrics to produce holistic funnels and KPIs; define leading indicators and build early-warning / nowcasting approaches for performance health. Engineer robust features from logs, sessions, sequences, and text; handle seasonality, cold start, sparsity, and platform-specific biases. Establish model governance: backtesting, stability monitoring, drift detection, fairness and bias assessment, and clear documentation of More ❯

shape a data-driven culture within the marketing team. As a key analytical partner, you will be responsible for deep-dive analysis, A / B testing, and performance measurement, ensuring that the company makes data-driven decisions at every level. Location: Remote, must be UK-based Salary … aligning performance measurement with business objectives and revenue goals. Build interactive dashboards and reporting tools to enable stakeholders to make data-driven decisions. Design and execute A / B tests and experiments, ensuring statistical rigour in performance analysis. Partner with the Marketing team to optimise business strategies through data. Lead post-campaign analysis, pre-campaign … with the ability to work cross-functionally and present insights to non-technical stakeholders. Deep understanding of analytics best practices, experimental design, and statistical significance in A / B testing. Exceptional attention to detail and a quality-focused approach. Nice to Haves Experience in the gaming industry. Experience working with dbt for data More ❯

re committed to expanding our reach and impact, offering you the opportunity to be part of our exciting journey. As a Director of Paid Acquisition & Growth (m / f / d) at FORMEL SKIN, you will take full ownership of our acquisition engine and lead the next phase of growth. In this role, you'll drive … Optimization (CRO): Build and run a structured CRO roadmap. Own experimentation across the website and user funnel to systematically increase conversion rates. Lead on A / B testing and work closely with Product and Design. Go to Market: Develop and execute acquisition strategies for launching new products and markets. Ensure fast … acquisition channels (e.g., Google, Meta, TikTok), with a track record of managing 7 figure budgets effectively. CRO & Experimentation Skills: Strong background in conversion optimisation, A / B testing, and funnel performance analytics. GTM Execution: Experience launching products in new markets or segments, with strong strategic and operational capabilities. MarTech & Automation: Hands More ❯

the differentiation of Constructor to prospects will be critical. Our next Solutions Architect is well-versed in enterprise eCommerce and has experience with Cloud technologies, data science and analytics / testing principles, SaaS, solution design, software development methodology, security requirements, SaaS architectures, and enterprise integrations. You are comfortable presenting to prospects and partners to showcase Constructor's … solutions that comprise retailer technology stacks Ability to comprehend complex data structures and prescribe best practices to optimize them Familiarity with data science and statistics principles, A / B testing methodologies and analytics Ability to explain AI and Machine Learning concepts to both technical and non-technical audiences This role is ideal for … agents. Engineering is by far our largest department, and we've built our proprietary engine to be the best on the market, having never lost an A / B test to a competitive technology. We're passionate about maintaining this and work on the bleeding edge of AI to do so. Out of More ❯

D2C business. Private Equity backed As the Website Manager, you’ll be instrumental in shaping the launch and growth of a new website, supporting A / B testing and conversion rate optimisation, while leading ongoing enhancements to user experience, site performance, and content effectiveness. Key Responsibilities: Manage the daily operation and … website metrics. Regularly update website content, resolve bugs. Identify improvements to UX, UI, and on-site content for better engagement and performance. Plan, execute, and analyse A / B and multivariate tests to support data-driven decisions. Track and optimise site speed, uptime, and overall technical performance. Lead the planning, development, and implementation of a … fast-moving B2C or multi-site organisation. Strong experience working with CMS platforms, particularly WordPress and HubSpot. Hands-on experience with CRO strategies and A / B testing tools. Proficiency with web analytics and performance tracking systems. Solid understanding of HTML, CSS, and basic JavaScript. In-depth knowledge of SEO best More ❯

AOV. Roadmap Prioritization & Execution: Support the creation of the product vision, goals, and roadmap and manage a dynamic and evolving product backlog, prioritizing and A / B testing new ideas. This may mean: synthesizing new feature requests, working with site merchandisers to drive improvements to our content management system, partnering with … competitive analysis, evaluate other retailers, and stay informed on the industry and evolving technologies in this space. About You: 5-7+ years experience in a B2C / DTC ecommerce environment, preferably running Shopify stores 5-7+ years of product management, project management, and / or digital experience Analytical with a test-and … Shopify Plus, Commerce Cloud, etc. Experience with Web Analytics tools e.g. GA4, Heap, Fullstory, etc. Experience with Content Management Systems e.g., Sanity, Contentful, etc. Experience with A / B Testing Options e.g., Server Side, Optimizely, etc. Experience with Google Tag Manager and third party data platforms Benefits We Offer: Competitive salary, stock options More ❯

digital integrations and web development agencies Ensure backlog is groomed and prioritized according to the overall strategy and product roadmap Create effective user stories, workflows, functional requirements, wireframes, and / or mockups Synthesize user feedback and report on KPIs to maintain digital product health and drive future product decisions Solicit internal recommendations and include key stakeholders in discussions regarding … and brand building focus) Obagi B2B (launch support, ongoing maintenance and semi-regular optimizations) Loyalty Platform : Professional Loyalty (Account Support & Platform Optimizations) DTC Loyalty (Launch & Optimizations) A / B Testing Platform : DTC site CRO experimentation (2 testing domains) B2B site UX experimentation What You'll Need: A bachelor's … Marketing, Advertising, Graphic Design or similar related fields strongly preferred At least 4-6+ years of relevant experience managing DTC and B2B digital platforms Prior experience within CPG / beauty industry highly preferred Strong understanding of web technology fundamentals and technical / operational requirements of products and projects Deep understanding of UX / UI best practices More ❯

data scientists, identify opportunities for business impact, understand, refine, and prioritize requirements for machine learning models, drive engineering decisions, and quantify impact. Hands-on develop, productionize, and operate ML / AI models and pipelines at scale, including both batch and real-time use cases. Leverage third-party and in-house ML / AI tools & infrastructure to develop reusable … serving and ease of model quality upkeep. Example projects include: feature platform, model interpretability, hyperparameter optimization, concept drift detection. Your Expertise: 12+ years of industry experience in applied ML / AI, inclusive MS or PhD in relevant fields. Strong programming (Scala / Python / Java / C++ or equivalent) and data engineering skills. Deep understanding of … ML / AI best practices (e.g. training / serving skew minimization, A / B test, feature engineering, feature / model selection), algorithms (e.g. neural networks / deep learning, optimization) and domains (e.g. natural language processing, computer vision, personalization, search and recommendation, marketplace optimization, anomaly detection). Experience with 3 or more More ❯

B2C Website Manager / Digital Manager (Office Based), Oldbury, £40-50k This successful and stable company is now seeking a professional and organised Website Manager to join and lead their existing In-House Team. Based at the Head Office, and reporting to the Directors , this role will be a combination on hands-on and … managing the existing team (6-8 people), so prior experience in supervising / managing a team is essential. Although a Digital role you will also be involved in assisting further increasing foot traffic into branch. Responsibilities: Create and implement agreed marketing strategies across all marketing channels including keyword research and competitor analysis, to ensure business … to improve digital performance. Plan, develop, implement, monitor and optimise all Paid Marketing Campaigns, including Google Ads, Meta, Pinterest, YouTube etc. Track campaign success and report on findings, identifying / suggesting improvements to increase CTR. Ensure SEO best practices are followed. Analyse website performance and customer behaviour to identify opportunities for CRO (conversion rate optimisation). Conduct A More ❯