Skip to main content
Solved

How can I change the list of emails in my A/B test campaign?


Forum|alt.badge.img+2

Hello,

I sent an A/B test campaign out two days ago and I'm planning to resent it again next week. I would like the 20% of the campaign’s recipients who received variation A, to receive next week the variation B and the other 20% who received variation B to receive next week variation A.  

What's the best way to modify the email list to make this happen?

 

I hope you guys understant my question. :)

 

Thanks,

Best answer by bluesnapper

Hi @Horgans

You can't get exactly what you're looking for because it's only possible to segment who received variant A and who received variant B over the entire send.

So if variant A was the winner, the variant A segment will include 80% of your list that received it (20% from the test + 60% from the final send), while the variant B segment will include the 20% of your list who received the losing variant B during the split test.

However, the following will allow you to send variant A to contacts who receive variant B and send variant B to contacts who receive variant A across your entire send:

  • You create two segments: one that populates with the contacts who received variant A and one that populates with those who received variant B. Segment set-up below.
  • You send two campaigns next week, one to each segment with the alternative message variant for each segment.

This approach will still result in contacts receiving a different variant to the one they received in your first campaign. You could also add another split test for each of those campaigns too.

Hope that helps

Andy

 

 

View original
Did this topic or the replies in the thread help you find an answer to your question?

3 replies

bluesnapper
Partner
Forum|alt.badge.img+45
  • Champion & Partner
  • 737 replies
  • Answer
  • October 27, 2023

Hi @Horgans

You can't get exactly what you're looking for because it's only possible to segment who received variant A and who received variant B over the entire send.

So if variant A was the winner, the variant A segment will include 80% of your list that received it (20% from the test + 60% from the final send), while the variant B segment will include the 20% of your list who received the losing variant B during the split test.

However, the following will allow you to send variant A to contacts who receive variant B and send variant B to contacts who receive variant A across your entire send:

  • You create two segments: one that populates with the contacts who received variant A and one that populates with those who received variant B. Segment set-up below.
  • You send two campaigns next week, one to each segment with the alternative message variant for each segment.

This approach will still result in contacts receiving a different variant to the one they received in your first campaign. You could also add another split test for each of those campaigns too.

Hope that helps

Andy

 

 


Forum|alt.badge.img+2
  • Author
  • Contributor I
  • 1 reply
  • October 29, 2023

Hello,

That is great! Thanks for your help :)


bluesnapper
Partner
Forum|alt.badge.img+45
  • Champion & Partner
  • 737 replies
  • October 31, 2023

No problem @Horgans All the best for your split test :-) Anything else, please let me know

Regards

Andy