3 ms·
That's why the GP was taking about weak priors. You just don't run an A/B test for 6 months hoping that a new design increases sales, get results pointing that
by marcosdumay 6y ago
That's why the GP was taking about weak priors.
You just don't run an A/B test for 6 months hoping that a new design increases sales, get results pointing that the new design reduces sales by 90%, and then go make another 6 months long test to make sure the sales indeed fell.
Acknowledging the numbers on that single dimension are different from what you expected isn't the same as testing a bunch of different dimensions. And if your hypothesis does not allow for it, you completely failed at rational thinking.