4 ms·
Just as a note: if I ran an A/B test and one bucket had 8,004 visitors and the other had 6,622 visitors, I'd be concerned about the way the test was setup. The
by birken 6y ago
Just as a note: if I ran an A/B test and one bucket had 8,004 visitors and the other had 6,622 visitors, I'd be concerned about the way the test was setup.
There are some valid possibilities to explain the discrepancy, but there are also a lot of possibilities in which the test wasn't setup properly and it isn't measuring the right thing.
When you get a test result that confirms your suspicion, the first thing you should do is challenge those results.
- conradludgate 6y agoIt doesn't look like they A/B tested. More likely just switched to it 100%
- antipaul 6y agoEven more of a problem for interpretation of these results...