6 ms·
> to date we have not failed a single A/B test This smells fishy. If you're experimenting with a typical p < 0.05 (which is often too high for ecommerce optimi
by danpalmer 6y ago
> to date we have not failed a single A/B test
This smells fishy. If you're experimenting with a typical p < 0.05 (which is often too high for ecommerce optimisation), surely you'd expect to fail 1 in 20 by chance, even if your product is better?