Skip to main content
Solved

Popup Form Holdout Test


Forum|alt.badge.img+6

I want to A/B test a popup form and create a hold-out audience.

 

So, Version A is delivered to 50% of the audience and Version B is empty - they get nothing.

 

How can I accomplish this with Klaviyo forms?

Best answer by KatherineB

@Andrew.Walters Hi there! If this pop up will be showing to subscribers on your list (as opposed to new site visitors), another idea would be to sample the list/segment you’re using to split it in half, and exclude one of the halves from seeing your pop up. 

Here’s a Klaviyo resource about sampling: https://help.klaviyo.com/hc/en-us/articles/115001145931-How-to-take-a-random-sample-of-a-list-or-segment

View original
Did this topic or the replies in the thread help you find an answer to your question?

5 replies

Forum|alt.badge.img+6
  • Author
  • Problem Solver I
  • 30 replies
  • February 10, 2023

@KatherineB,

This popup is showing to new site visitors and not existing customers.

 


KatherineB
Partner - Platinum
Forum|alt.badge.img+23
  • Champion & Partner
  • 150 replies
  • Answer
  • February 3, 2023

@Andrew.Walters Hi there! If this pop up will be showing to subscribers on your list (as opposed to new site visitors), another idea would be to sample the list/segment you’re using to split it in half, and exclude one of the halves from seeing your pop up. 

Here’s a Klaviyo resource about sampling: https://help.klaviyo.com/hc/en-us/articles/115001145931-How-to-take-a-random-sample-of-a-list-or-segment


Akers Digital
Partner - Silver
Forum|alt.badge.img+21
  • Partner - Silver
  • 139 replies
  • February 3, 2023

You can use a custom trigger to have the form only show to half of your web visitors. But you would need an AB testing platform to do this. 

I’ve not tried it, but you might be able to accomplish this through Google Optimize which is a free AB testing tool from Google.

 

Google just announced they are shutting down Google Optimize next year, which I am a little bummed about. 😢 But we still have a year to use it!

 


Forum|alt.badge.img+6
  • Author
  • Problem Solver I
  • 30 replies
  • February 3, 2023

I want to know if the offer I’m giving in the popup form is creating a lift in revenue.


Taylor Tarpley
Community Manager
Forum|alt.badge.img+60
  • Community Manager
  • 2148 replies
  • February 3, 2023

Hi @Andrew.Walters

 

Thanks for sharing your question with us! 

 

Do you mind sharing the goal of your form? While this isn’t a native feature within A/B testing, I’d be happy to see if how we create a workaround to accomplish your goal! 

 

Thanks for participating in the Community!

-Taylor