DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone >

What is A/B Testing?

David Shaw user avatar by
David Shaw
·
May. 10, 13 · · Interview
Like (0)
Save
Tweet
4.31K Views

Join the DZone community and get the full member experience.

Join For Free

If you run a website or are involved in conversion rate optimization then you are certain to have heard about A/B testing, but what is it?

a-b-testingWhat is A/B testing?

In its simplest form A/B testing is the process of testing a new variation of a webpage against the current version in an attempt to increase the conversion rate of a defined goal.

An example would be an e-commerce website who may want to test a different ‘Add to Basket’ button on their website. They create a new version of their product page, this is usually called ‘the challenger’ or ‘the variant’. When visitors arrive at the website they are split with one set seeing the original page and the other set seeing the new variant page.

The split is usually 50/50, however it is no uncommon to see 75/25 or 90/10 for riskier tests. Your split percentage will largely depend on the amount of traffic to your website as you need to ensure that there is enough volume going through each split in order to reach a significant result. I would advise anyone new to A/B testing to stick with 50/50 until they are more confident with calculating the number of people required through their split.

Once the test has received a sufficient amount of traffic, analysis can then be undertaken to calculate the winning split. The winning split is generally the split with the highest conversion rate  as this split will convert more visitors into buyers. One key consideration is the significance of your test results, you need to be sure that enough data has been collected to provide a statistically significant result. Tools such as this A/B Test Significance Calculator are great for checking if you are in a position to end your test and select a winner.

Once you have a significant response you can select your winner and put that variation live across your website. You are then ready to start your next test.

If you are new to A/B testing then it is good to know that you should generally only be running one test on your website at any one time as running more than one test may produce faulty figures as the tests may conflict with each other.

Hopefully this helps to answer the question of what is A/B testing and you are ready to start testing on your website.

If you have any questions regarding A/B testing, feel free to leave them below.

A/B testing

Published at DZone with permission of David Shaw, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • SQL CTE: How to Master It in One Sitting With Easy Examples
  • Creating an Event-Driven Architecture in a Microservices Setting
  • MACH Architecture Explained
  • Five Tips to Fasten Your Skewed Joins in Apache Spark

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo