An A/B test of a popup shows visitors different versions of the same popup and counts which one converts best. Change one thing, such as the heading, the button or the look, and let the numbers decide. Popup A/B tests run inside the Popups tool. To test changes to a page instead, use the A/B testing tool.
Start a test
- Open Popups and click A/B tests in the top menu.
- Under Which popup do you want to test?, click Test this popup next to a popup. The builder opens on the A/B test tab.
- Click Add variant. WEMASY makes a copy of the popup.
- Click the pencil icon (Edit this version) next to the variant and change one thing in its content, form or look.
- Click Back to the original to return to the test.
- Set the share of visitors per version in the % fields. Together they must make 100%. Click Save split.
- Click Start test.
You can also open the A/B test tab of any popup directly in the builder. When and where a variant shows comes from the original, so the trigger and targeting stay the same for every version.
While the test runs
- Each visitor keeps seeing the same version.
- Versions cannot be added or removed. Stop the test first.
- Every version shows its Views, Conversions and Conversion rate, and the difference with the original.
Read the result
Under each variant a bar shows how sure WEMASY is that it really converts differently from the original. A result counts from 95% and at least 30 views per version. Until then the bar says "not enough yet". The best version so far is marked Leading.
Pick the winner
- Click Use this version for everyone under the best version.
- Confirm. The test stops and every visitor gets that version.
To stop without a winner, click Stop test. Start again (counts from zero) restarts the test with new numbers.
See all your popup tests
The A/B tests page lists every popup test with its status, how long it ran, the share per version, the result against the original and how sure it is. It also shows the total Tests running, Views in tests and Conversions in tests.
Frequently asked questions
Do variants count toward my monthly popups?
No. Versions in an A/B test do not count as new popups for your plan.
What should I test first?
Test one thing at a time, such as the heading or the button text, so you know what made the difference.
Related: Popup statistics and Getting started with A/B Testing for tests on your pages.