Skip to main content

I’m trying our first A/B testing on our sign up pop up.  And need to check I’ve done it properly. 

Current scenario - we ask for name & email address on our sign up pop up. 

Test - I want to remove the name name to see if we get more sign ups. 

I have created an A/B test.  Copy A removes the name box, Copy B retains the name box.

Is that correct?

Thank you

Hi ​@Jessica Parrish,

Your A/B test setup sounds correct! You've structured it properly to test the impact of removing the name field on sign-up conversions.

A few recommendations to ensure your test runs effectively:

  1. Allow sufficient time for results: Wait for statistically significant results or until you have a sufficient sample size of viewers to end your test. Don't end the test too early based on initial impressions.
  2. Monitor the right metrics: Focus on your submit rate (conversions) rather than total views. The goal is to see if removing the name field increases the percentage of people who complete the form.
  3. Don't make changes mid-test: Don't alter test settings while it's live, let it run until you have clear, statistically significant results.
  4. Consider the bigger picture: While Copy A (email only) might get more sign-ups, consider whether having names helps with personalization in your follow-up emails. Sometimes, a slightly lower conversion rate with names can lead to better long-term engagement.

You can monitor your results in your form's A/B Test Results tab, where you'll see submit rates, win probability, and other key metrics for each variation.

This is a classic and valuable test - many brands see improved conversion rates when reducing form friction. Good luck with your first A/B test!

For reference, check out this Klaviyo Help Center article: How to A/B test a sign-up form.


Thank you Obeth, that’s really helpful feedback. 


Fantastic word, Obeth. 

FWIW -- personalizing with first name does not typically help with that first purchase conversion (my anecdotal take), so if your test shows that you are able to drive more signups without collecting first name, you are likely not missing much in terms of that first purchase conversion. Industry and product pending, of course. 

For those who do sign up and purchase, you will collect that first name during their purchase, at which point having that first name will be helpful to drive the 2nd, 3rd (and so on) conversions by being able to speak to them more personally as your relationship extends. 


Hi Greg / And Obeth

I’m really struggling with sign ups. People see to see the pop up but have a really low take up, it’s got better but still low.  Month to date it was 2.51% (but that’s only 9 sign ups of 359 viewed) I have the A/B test running but whilst this is happening would you suggest I do the multiple pop ups rather than just the one? Or leave this basic test running.  I’m just worried that at the moment, we’re not getting much through. 

Appreciate your thought thoughts. 


Thanks


Reply