About A/B test

Hello @kimmia,

Thanks for sharing to the Community.

For your first question, I believe this would depend on how long it would take for a user to complete your flow correct?  It would also depend on the # of contacts you are sending the flow variations too. In the same vein, while still testing one variable at a time, the more variations you add, the bigger the audience you’ll need to make sure you get reliable results. To get your results in a timely manner so you can perform more tests, use no more than four variations of one variable per test.

Imagine you have a great idea for a form, you A/B test it, and, on the first day, the first 10 people who see the form click through and make a purchase. Over the course of a week, the next 2000 people exit out of the form immediately. If you had ended the test after the first day, you would think that your form was great, even though a larger audience showed otherwise. By waiting until your results are statistically significant or until you have a good sample size of viewers, you’ll ensure that you know which form is truly better for your brand. Although we do not have a minimum # of people for a test, the more involved the better your data will be (that is true for anything).

For further information regarding your A/B test, I would recommend reaching out to Support to see if they can provide more detailed info into your account that we cannot see from screenshots. 

Thanks,
Alex

@alex.hong 

How is Win probability calculated , Chi-Squared Test or something else?