How to Check Your A/B Test Results
All your A/B tests and their results live on the A/B testing page in your Dialogue dashboard.
Find your tests
Section titled “Find your tests”- Open A/B testing from the left menu.
- Scroll to Your current tests.
Each row shows:
- Status: Draft, Active, Paused or Completed.
- Name, Created date and Run time.
- Goal: the metric that decides the winner.
- Results: Need more data, Not certain, or which version won.
Open the results
Section titled “Open the results”Click a test row, or open its menu and choose Overview. The exact layout depends on the type of test. The results page shows:
- Test details: status, goal, start date, devices and the pages the test runs on.
- A chart of how each version performs over time.
- A comparison table with the numbers for each version. Your original page is shown as Original. Click Preview to see a version on your store.
- Dialogue’s Insight: a short, plain-language summary of what the results mean.
Results update as shoppers see your test. Early numbers can swing a lot, so give your test time. See How Dialogue Picks an A/B Test Winner for the rules a test must meet before a winner is called.
When there’s a winner
Section titled “When there’s a winner”When one version clearly wins, the Results column in your tests list shows which version won. On the results page you’ll also see a message with the winner’s name. If it comes with a Make it 100% button, click it to show the winning version to all your shoppers.
Stop or change a test
Section titled “Stop or change a test”- Click Finish on the results page to end a running test.
- Click Edit to change it. Some tests need to be stopped and started again as a new test to change them. Dialogue asks you first.
- From the menu on each row in Your current tests you can also Rename or Remove a test.
Need help? Open the chat in your Dialogue dashboard and ask Dia, or ask to talk to a person.