5 ms·
Resource provided uses a very naive approach to determining the outcome of an AB test. It's not accurate, given the very small numbers.
by artiscode 8y ago
Resource provided uses a very naive approach to determining the outcome of an AB test. It's not accurate, given the very small numbers.
- bemmu 8y agoYes, I don't have much data to work with, and was also surprised that the calculator considered this significant. But even without significance, I assume it still makes sense to go with the winner?
- no_gravity 8y agoDoes the calculator really use the word "significant"? I don't see it. I am not sure how to interpret the language it uses. As for going with the winner: Yes, if the test result (39/28) is the only information you have and there are only two choices (go with winner / go with loser) then it makes sense to go with the winner.