Using A/B tests in Blueshift, you can see which variant of a template performs better. You can test several templates that may have different forms of personalization or entirely different content. For email templates, you can also conveniently test different subject lines for the same content.

You can set up the A/B test from the A/B Test tab of the trigger.

jb_abtest.png

Email subject line tests

To set up a Subject Line A/B test, complete the following steps:

  1. Select an Email Template from the Email tab of the trigger.
  2. Click Create A/B Test or go to the A/B Test tab to set up the test.
  3. On the A/B Test tab,  select Subject Line as the Type.
  4. Click Add Variation to add a new subject line and the percentage of users to allocate to it.
    • You can use the same markup to customize the subject as you would for the email template.
    • You can add up to 20 subject lines to test.
    • The first subject line is your control (the default subject line of the email template) and cannot be edited.

jb_abtest_subjectline.png

After you set up the Subject Line A/B test, you can view the information for the test on the journey component in both the Compact and Detail modes.

jb_abtest_subjectline_view.png

Message content tests

To A/B test non-email templates or content beyond just subject lines, you must create several templates to use in the tests. If your templates are similar to each other, you can use the “clone” functionality after creating one template and edit the cloned template.

jb_clone_template.png

To set up an Entire Creative A/B test to test the message content, complete the following steps:

  1. Click Create A/B Test from the Email tab or go to the A/B Test tab to set up the test.
  2. On the A/B Test tab, select Entire Creative as the Type.
  3. Click Add Variation to add a new template and the percentage of users to allocate to it.
    • You can add up to 20 templates to test.
    • The first subject line is your control (the default subject line of the email template) and cannot be edited.

jb_abtest_creative.png

After you set up the Entire Creative A/B test, you can view the information for the test on the journey component in both the Compact and Detail modes.

jb_abtest_content_view.png

Measuring & Optimizing Campaigns

Once the campaign is live, you can access the detailed analysis under the Reports > A/B Test Results tab of the campaign studio. For each template, you will see the number of users, impressions, clicks as well as orders/revenue and custom goals data. This helps you measure template changes and their effect on downstream conversions and custom goals.

For more information, see A/B Test Reports.

Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.