Campaign Optimizer Agent – FAQs

This page answers common questions about using the Campaign Optimizer Agent and explains key terms you’ll see in the interface.

Frequently asked questions

1. How long does it take for variants to be generated after I enable the Campaign Optimizer Agent? +
Variants are typically ready within 20–30 minutes of enabling the Campaign Optimizer Agent on a messaging trigger.
2. Will I be notified when variants are ready for approval? +
You'll receive an email notification once the variants are generated and ready for review.
3. Can I edit the variants generated by the Campaign Optimizer Agent? +

Yes. In addition to the suggested variants (A–C), you’ll see a Variant D (Custom) option. With Variant D, you can:

  • Copy Variant A/B/C, edit it, and save
  • Pick from the Content Library — a collection of all variants generated by the tournament
  • Start fresh and write your own variant
4. What can the Campaign Optimizer Agent currently optimize? +
  • Email: subject line and preheader
  • SMS: message content

This list is updated as new channels become available.

5. What happens if the test variant doesn't perform well? +
If the test underperforms significantly, it's archived, and the control variant continues. The Campaign Optimizer Agent may then generate a new variant to test.
6. Can I stop an ongoing test manually? +
Yes. You can stop the test at any time. This will route all traffic to the control variant and restart the content generation process.
7. What if my campaign has multiple triggers? +
Each trigger is treated independently. The Campaign Optimizer Agent must be enabled per trigger, and variants are created separately for each trigger.
8. What do the different Campaign Optimizer Agent statuses mean? +
  • Generating content: The Campaign Optimizer Agent is creating and ranking test variants for approval.
  • Approval pending: Variants are awaiting user approval before testing can start.
  • Approval denied: Variants were rejected during approval; this set will not proceed to testing.
  • Approval expired: If the test was in Generating content or Approval pending status and you switched the mode from Optimizer Agent to Manual, the status changes to Approval expired. This ends the approval process.
  • Test running: An approved test is in progress (optimization or observation).
  • Success: The variant achieved significantly positive lift and is promoted over the control.
  • Failure: The variant did not meet success criteria (negative lift or no significance within the limit).
9. What are some important Campaign Optimizer Agent terms to know? +
  • Campaign Optimizer Agent: AI engine for discovery, content generation, and testing.
  • Opportunity discovery pipeline: List of surfaced optimization suggestions.
  • Opportunity score: Combined metric measuring potential for improvement.
  • Content score (AIDA): Quality score based on Attention, Interest, Desire, Action.
  • Priority score (RICE): Prioritization metric based on Reach, Impact, Confidence, and Effort.
  • Tournament history: Record of content generation tournaments. Winning variants from these tournaments are proposed by the Campaign Optimizer Agent for A/B testing (not a history of A/B tests themselves).
  • Lift: Observed improvement in performance between control and test (projections are not shown).
  • Statistical significance (sig): Confidence level that results are not due to chance.
  • Traffic allocation: Percentage split of user traffic between control and variants.
  • Conversion rate: Percentage of users completing the desired action.
10. What is the Approvals & Opportunities tab, and what does “Discover Opportunities” do? +

The Approvals & Opportunities tab serves as the primary entry point for system-suggested tests. It lists high-potential triggers ranked by score, with rows showing one of two statuses:

  • Approval pending: Variants already generated and waiting for your review.
  • Opportunity: A system-surfaced suggestion where variants have not yet been generated.

Clicking Discover Opportunities refreshes the list by scanning campaigns and triggers in real-time to identify new optimization suggestions.

11. Does clicking Content Generation start the A/B test? +
No. Clicking Content Generation only creates variants you can review and set up for testing. The test itself does not begin until a variant is approved and launched.
12. Why do my tests show an end date 90 days out? +
The end date depends on the send volume of the trigger in the last 7 days. The Campaign Optimizer Agent estimates the time required to reach the minimum sample size necessary for a stable, statistically significant result. For low-volume triggers, this duration can extend up to 90 days.
13. Why is the test end date still in the future even when lift looks positive? +
A test may show significantly positive lift early, but the system continues until the optimization phase ends. This helps rule out initial bias or variance. The optimization phase length is based on the days required to reach the minimum sample size from the trigger’s send volume. If needed, you can manually copy the test variant to the control and end the test once you’re confident in the results.
14. What tracking parameters are added to AI-optimized variants in the Campaign Optimizer Agent? +

Links in AI-optimized triggers from the Campaign Optimizer Agent include two tracking parameters:

  • bsft_variant_src — Indicates whether the variant was AI-generated (ai) or human-authored (non-ai).
  • bsft_variant_type — Indicates whether the variant was the control (control) or the test (test) at the time of sending.

These parameters appear only in the message links. They do not appear in the Campaign Optimizer Agent interface or reports.

 

  How to enable the Campaign Optimizer Agent

The Campaign Optimizer Agent is currently available upon request. To enable it on your account, please contact your Customer Success Manager (CSM).

Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.