4 ms·
It doesn't have to be a pure science interest. If you want to use the results from one test to inform what to test next, then A/B tests are better optimizing f
by mobjack 7y ago
It doesn't have to be a pure science interest.
If you want to use the results from one test to inform what to test next, then A/B tests are better optimizing for truth.
Most website changes dont make a significant difference in conversion. If you use MAB, then you dont know if the winner is really better or the result of random variation.
- paulddraper 7y ago> If you use MAB, then you dont know if the winner is really better or the result of random variation. No, you know the outcome of MAB is the best. If it's clearly the best, it converges quickly. If it's less clearly the best, it converges slowly. Either way though, you haven't lost any more conversions that necessary to find that out, or needed to put in non-mathematically fail safes.