Uniform random sample split
TLDR
You need to adjust the probabilities of a random sample split, if you have more than 2 paths and want a uniform distribution.
Personal story
Recently I created a 4-path split. My idea was simple - equally split the audience among the 4 paths, so 25% random sample on each path should be enough - at least that was what I thought.
If you click on the split element, you see that over each path a notification pops up: “Check first”, “Check second” and so on… That means that Klaviyo (correct me if I’m wrong) checks the first path and then the second one, and so on - path criterias are being checked in order and not independently of one another. What isn’t a problem for properties likes “Hasn’t placed an order in the last 5 days”, is actually a problem for random samples because of how probabilities work.
Probabilities
The probability of the second path being chosen with them both having 25% random sample, is 3/4*1/4=3/16 < 4/16=1/4. Imagine that 1/4 of your audience is on the first path (just like they should), then the remaining audience is 3/4. That means that the second path will be chosen for one quarter of 3/4 and not one quarter of 1 (100%) like it should be.
Solution (4 paths)
The solution for 4 paths is: 25%, 33%, 50%, 100% (being “everyone else”). This can be proven by calculating the probabilities for the second path: 3/4*1/3=3/12=1/4; the third path: 3/4*2/3*1/2=6/24=1/4; and the fourth path is just everyone else, so the remaining 25%.
It may sound complicated but it makes sense, once you play with the numbers on paper. Of course you can just ask Composer or any LLM to calculate the right probabilities.
Image:

Potential problems
The thing is that not everything that is intuitive, is also correct statistically. Problems will arise if you for example will compare the Conversion Rates for different paths and will see, that the first path is performing better than the rest. It does not mean that the first path is performing better, but rather that it has a larger customer group.
