3 ms·
> 21% more people clicked on the red button than on the green button. Everything else on the pages was the same, so it was only the button color that made this
by benblodgett 13y ago
> 21% more people clicked on the red button than on the green button. Everything else on the pages was the same, so it was only the button color that made this difference.
I think it is a bit of a reach to immediately jump to concluding red outperforms green. Cohorts in a/b testing are not always equal (even if the traffic split is 50/50).
Imagine situations where 30% of a has 70% more mobile users than those of b. The green used for b is significantly less noticeable on mobile than desktop.
Can we still reasonably conclude that color defined the conversion difference?
- gingerlime 13y agoImagine situations where 30% of a has 70% more mobile users than those of b Wouldn't this be statistically impossible (i.e. extremely unlikely) given a big-enough data-set in a properly designed A/B test platform?