Hi,
I’ve had an A/B test running on a flow and I was under the impression that the test would end automatically once statistical significance was reached, which according to this article is defined as:
- At least 500 recipients have received each variation.
- A variation has at least 90% win probability.
As far as I can tell, this test (pictured below) satisfied both criteria, but it still says it’s not statistically significant. In the end I just manually chose the winner, but could someone explain why this wasn’t classed as statistically significant?
Best answer by Brian Turcotte
View original
