Skip to main content
How To AB Test Your Dialogue Assets

Make Data-Driven decisions and optimize your Dialogue assets with A/B Testing. Test Campaigns, Text, Messaging, Rules, Segments & much more!

Updated over 5 months ago

A/B Optimize Highlights

  • Dialogue's A/B Optimize feature allows you to leverage real-time data to identify assets that truly captivate your customers, and increase sales.

  • By comparing different versions of products or features you can analyze user experience and achieve desired outcomes, such as increased sales or engagement.

  • A/B Optimize will provide you with insights into which design, content, or layout changes have a significant impact on user behavior within your Dialogue assets.

  • Dialogue offers A/B performance testing for your entire website as well - learn more about A/B Commerce instead.


How To Start Your A/B Optimize Testing?

Home Page Left-Side Panel> A/B Optimize > Choose Test > Optimize!

Start off at the Dialogue Home page left-side panel, and click on A/B Optimize.

Then choose the type of test you want to create.

Name your test, add a description (optional), choose the winning metric you want to determine the winning group, and set whether you want your test to end automatically once the results are significant, or manually whenever you decide.

Not sure How To Choose A Winning Metric? Sign Up for our upcoming Metrics Webinar


5 Types of A/B Optimize Testing & How To Launch Them


1. Test Asset Performance

Can't decide whether to display a specific asset?

Test your store's performance in terms of AOV or CVR with & without that asset.

Available Metrics: Conversion Rate | AOV

Creating & Launching The Asset Performance Test:

πŸ‘€ Before starting the Asset performance test, we will make sure no other tests are running parallel to it. We do this to ensure that the presence of the asset is the only difference the users from groups A and B experienced in their user journey.

Now you can launch the Asset Performance Test:

  1. Specify which asset is up for the test.

  2. Choose 2 groups:

    1. Group A will see the tested asset.

    2. Group B will experience your store without ever seeing the asset.

2. Test Between 2 Assets

Wondering whether to display a banner or a carousel? Split traffic and test 2 different assets that are positioned on the same page in your store.

Available Metrics: Pure Sales | CTR

Creating & Launching The Test Between 2 Assets:

  1. Choose an asset you want to expose group A to.

  2. Choose a different asset for group B to be exposed to.

3. Test Rules

Considering 2 different rules for an asset?

Test between 2 versions of rules of the same asset to verify which works better.

Available Metrics: Pure Sales | CTR

Creating & Launching The Rules Test:

Start by choosing the asset and segment you want to test through the settings for group A. you will then see the rules for group A filled automatically according to the current rules for that segment.

Then, choose different rules to display to group B.

You can create a custom rule to test on group B.

4. Test Text & Messaging

How can you tell which headline would be most engaging?

Simply compare between 2 options.

Available Metrics: Pure Sales | CTR

Creating & Launching The Text & Messaging Test:

  1. Choose the asset and segment you want to test on group A. The asset headline and button for group A fills automatically according to the current messaging for that segment.

  2. Choose different messaging to display to group B

5. Test Campaigns

Debating between 2 different campaigns?

Split traffic and offer a different campaign to each group to determine which offer performs better.
Available Metrics: Pure Sales | CTR

πŸ‘€ This test only works with manual assets.

Creating & Launching The Text & Messaging Test:

  1. Choose the asset and segment you want to test through the settings for group A. you will then see the campaigns that are currently assigned to that segment filled automatically.

  2. Assign campaigns from the dropdown to show to group B

Did this answer your question?