One time campaigns are sent to a pre-defined segment a specific date and time. We expect all our customers to adhere to our anti-spam policy.
- Create targeted user segments using a variety of filters
- Personalize your newsletter using various user attributes
- Insert dynamic promo codes
- Seasonal/Holiday Promotions
- Special offers/coupons
- Clearance Sales
- Free Shipping Offers
You would like to send a travel offer emails to select group of customers. To start, you will need to :
- Create the segment using various conditions
- Create content and insert dynamic personalization variables in subject line and body
- Launch one time campaign
For one time campaigns, you can enable automatic winner selection on messaging triggers that have multiple templates. Using this feature, you can let the campaign automatically select the best template based on the metric you are trying to optimize for.
Automatic winner selection performs the following actions:
- During campaign execution, it splits qualifying users for the messaging trigger into a test and holdout group.
- Instead of messaging all users, it only messages the users in the test group. Each test user is assigned a template in a round robin fashion.
- After the test group has been messaged, the campaign waits for some specified time period so that interactions can occur.
- After the waiting period is up, the campaign selects the winning template based on a chosen metric and messages the holdout group with this template.
This feature is toggled in the "Optimize allocation to creatives" section just below the template selection. It is disabled by default, as indicated by the "None, use custom percentages" description.
The "Optimize allocation to creatives" section will only appear if you have more than one template in the messaging trigger. If you still do not see the "Optimize allocation to creatives" section, contact your Blueshift Success Manager to have the feature enabled in your account.
Clicking on "None, use custom percentages" will open a model where you can enable automatic winner selection. Select "Use automatic winner selection" to expose the input parameters on the right.
Automatic winner selection uses three parameters:
- Test group size: This is the number of users to use for the test group, expressed as a percentage of the users who qualify for the messaging trigger. You should set this appropriately, so that each template variation gets enough users. This percentage will depend on several factors such as the number of template variations, the size of your segment and whether or not the campaign has multiple messaging triggers.
- Holdout period: This is the amount of time, in hours, the campaign will wait before selecting the winner. The minimum time is 1 hour and the maximum time is 24 hours.
- Optimizing metric: This is the metric used to select the winning template. The metric is calculated as a rate per users. For example, "unique impressions rate" is the number of impressions divided by the number of users. The built in metrics that can be selected are "unique impressions rate", "unique click rate", "revenue per user" and "orders per user". In addition, you can select any custom goals as your metric. These will also be calculated as a rate per user.
Push and SMS do not have impressions, so "unique impressions rate" is not available for these channels.
In order for automatic winner selection to work as intended, you must be careful when choosing the inputs. In particular, you should make sure you set the holdout period and metric such that there will be enough conversions on the metric you selected. You will probably need to take a look at your past campaigns in order to get a sense of what values will make sense. For example, let's say you notice that most orders are placed 3 hours after users receive a message. If you setup automatic winner selection with the metric "orders per user", but only use a holdout period of 1 hour, you are probably not going to get the desired result.
After hitting save, you will see the automatic winner selection settings reflected in the UI.
The percentages next to each template are hidden when using automatic winner selection because templates will be assigned to test users in a round robin fashion.
Note that send time optimization (in the "When" section) is unavailable when you are using automatic winner selection. Send time optimization introduces it's own delays that does not work well with automatic winner selection, which is why it is disabled. For that same reason, automatic winner selection is disabled when a one time campaign is using send time optimization.
As the campaign is executing, you can see how many users are in the holdout group on the campaign's detail page.
The campaign will remain in an "executing" status until all winners have been selected and all the users in holdout groups have been messaged. Pausing or re-launching the campaign may cause users to not get messaged.
When the campaign is complete, you will see an info box that identifies the winning template and how much lift was generated compared against the worst performing template.
If there is a tie, the template with more users is selected as the winner.
You will also see a "Winner Selection" section appear below the table. You can expand this section to get more detailed information on how the winner was selected for each messaging trigger.
You may notice that the number of test users for each template may not always be equal. Templates are assigned in a round robin fashion, but it is possible a test user will not get messaged. One reason may be that the user has no products for the particular recommendation you are using. Therefore, if you are using a recommendation, you should make sure that most users in your segment will have products returned.
The number of test users for each template do not need to be the same in order for automatic winner selection to work well. However, you do need to ensure that each template receives enough users such that the difference in users between templates does not skew the results. That is why it is important to set an appropriate test group percentage.