Popup Form Holdout Test

5 replies
223 views

I want to A/B test a popup form and create a hold-out audience.

So, Version A is delivered to 50% of the audience and Version B is empty - they get nothing.

How can I accomplish this with Klaviyo forms?

List growth & forms

This topic has been closed for replies.

KatherineBAnswer

Champion & Partner

@Andrew.Walters Hi there! If this pop up will be showing to subscribers on your list (as opposed to new site visitors), another idea would be to sample the list/segment you’re using to split it in half, and exclude one of the halves from seeing your pop up.

Here’s a Klaviyo resource about sampling: https://help.klaviyo.com/hc/en-us/articles/115001145931-How-to-take-a-random-sample-of-a-list-or-segment

Katherine - &BAM | 2023 Klaviyo Champion and Elite Partner

Taylor Tarpley

Community Manager

Hi @Andrew.Walters,

Thanks for sharing your question with us!

Do you mind sharing the goal of your form? While this isn’t a native feature within A/B testing, I’d be happy to see if how we create a workaround to accomplish your goal!

Thanks for participating in the Community!

-Taylor

A

Andrew.WaltersAuthor

Problem Solver I

I want to know if the offer I’m giving in the popup form is creating a lift in revenue.

Akers Digital

Partner - Silver

You can use a custom trigger to have the form only show to half of your web visitors. But you would need an AB testing platform to do this.

I’ve not tried it, but you might be able to accomplish this through Google Optimize which is a free AB testing tool from Google.

Google just announced they are shutting down Google Optimize next year, which I am a little bummed about. 😢 But we still have a year to use it!

KatherineBAnswer

Champion & Partner

@Andrew.Walters Hi there! If this pop up will be showing to subscribers on your list (as opposed to new site visitors), another idea would be to sample the list/segment you’re using to split it in half, and exclude one of the halves from seeing your pop up.

Here’s a Klaviyo resource about sampling: https://help.klaviyo.com/hc/en-us/articles/115001145931-How-to-take-a-random-sample-of-a-list-or-segment

Katherine - &BAM | 2023 Klaviyo Champion and Elite Partner