Ced, the part about the significance calculation is a problem with the A/B test, not a problem with the Bayesian bandit version. The post you're looking for is

Ced, the part about the significance calculation is a problem with the A/B test, not a problem with the Bayesian bandit version. The post you're looking for is http://lesswrong.com/lw/1gc/frequentist_statistics_are_frequently_subjective/ http://lesswrong.com/lw/1gc/frequentist_statistics_are_frequ...