DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Partner Zones AWS Cloud
by AWS Developer Relations
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Partner Zones
AWS Cloud
by AWS Developer Relations
Securing Your Software Supply Chain with JFrog and Azure
Register Today

Trending

  • Mastering Go-Templates in Ansible With Jinja2
  • Event-Driven Architecture Using Serverless Technologies
  • AI and Cybersecurity Protecting Against Emerging Threats
  • Revolutionizing Algorithmic Trading: The Power of Reinforcement Learning

Trending

  • Mastering Go-Templates in Ansible With Jinja2
  • Event-Driven Architecture Using Serverless Technologies
  • AI and Cybersecurity Protecting Against Emerging Threats
  • Revolutionizing Algorithmic Trading: The Power of Reinforcement Learning
  1. DZone
  2. Testing, Deployment, and Maintenance
  3. Testing, Tools, and Frameworks
  4. What is A/B Testing?

What is A/B Testing?

David Shaw user avatar by
David Shaw
·
May. 10, 13 · Interview
Like (1)
Save
Tweet
Share
4.66K Views

Join the DZone community and get the full member experience.

Join For Free

If you run a website or are involved in conversion rate optimization then you are certain to have heard about A/B testing, but what is it?

a-b-testingWhat is A/B testing?

In its simplest form A/B testing is the process of testing a new variation of a webpage against the current version in an attempt to increase the conversion rate of a defined goal.

An example would be an e-commerce website who may want to test a different ‘Add to Basket’ button on their website. They create a new version of their product page, this is usually called ‘the challenger’ or ‘the variant’. When visitors arrive at the website they are split with one set seeing the original page and the other set seeing the new variant page.

The split is usually 50/50, however it is no uncommon to see 75/25 or 90/10 for riskier tests. Your split percentage will largely depend on the amount of traffic to your website as you need to ensure that there is enough volume going through each split in order to reach a significant result. I would advise anyone new to A/B testing to stick with 50/50 until they are more confident with calculating the number of people required through their split.

Once the test has received a sufficient amount of traffic, analysis can then be undertaken to calculate the winning split. The winning split is generally the split with the highest conversion rate  as this split will convert more visitors into buyers. One key consideration is the significance of your test results, you need to be sure that enough data has been collected to provide a statistically significant result. Tools such as this A/B Test Significance Calculator are great for checking if you are in a position to end your test and select a winner.

Once you have a significant response you can select your winner and put that variation live across your website. You are then ready to start your next test.

If you are new to A/B testing then it is good to know that you should generally only be running one test on your website at any one time as running more than one test may produce faulty figures as the tests may conflict with each other.

Hopefully this helps to answer the question of what is A/B testing and you are ready to start testing on your website.

If you have any questions regarding A/B testing, feel free to leave them below.

A/B testing

Published at DZone with permission of David Shaw, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Trending

  • Mastering Go-Templates in Ansible With Jinja2
  • Event-Driven Architecture Using Serverless Technologies
  • AI and Cybersecurity Protecting Against Emerging Threats
  • Revolutionizing Algorithmic Trading: The Power of Reinforcement Learning

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com

Let's be friends: