4 ms·
Join us, comrade, in the fight against the statistical blight! Move your decision process to multi-armed bandit and you never have to decide when to end an A/B
by paulddraper 10y ago
Join us, comrade, in the fight against the statistical blight!
Move your decision process to multi-armed bandit and you never have to decide when to end an A/B test -- math does it for you, in a provably optimal way.
- RA_Fisher 10y agoI'm not sure this solves it because you have to have a really strong sense of the loss function to pull it off. That's much easier to intuit and use to guide experiments than actually build into the bandit algo.
- paulddraper 10y ago> That's much easier to intuit and use to guide experiments than actually build into the bandit algo. IDK about your intuition, but for most other people, it gets in the way of statistics. The "loss function" is just as easy to calculate for A/B tests as for multi-armed bandit. The value of user doing A is $X, the value of B is $Y, and the value of C is $Z.
- RA_Fisher 10y agoYou gave me some reading to do. :) Thank you.