5 ms·
A large percentage of experiments I've run were intended to only test if variant was worse than control, we didn't care much how much better the variant may be.
by dahdum 8y ago
A large percentage of experiments I've run were intended to only test if variant was worse than control, we didn't care much how much better the variant may be.
Usually these would be positive consumer facing features we were concerned may negatively affect conversion. The switch to Bayesian made that a lot easier to run.