3 ms·
Their A/B testing results are most likely due to chance. Using the technique from https://www.evanmiller.org/sequential-ab-testing.html https://www.evanmiller.
by mleonhard 6y ago
Their A/B testing results are most likely due to chance.
Using the technique from https://www.evanmiller.org/sequential-ab-testing.html https://www.evanmiller.org/sequential-ab-testing.html
N = 14626, sqrt(N) = 121
T = 45
C = 34
T - C = 11, far below the 121 required to declare the change a success with 95% probability.
T + C = 79, also below the 121 required to declare no winner.