4 ms·
Speaking of mature, well-built A/B test frameworks, Google Analytics uses multi-armed bandit. https://support.google.com/analytics/answer/2844870?hl=en https:/
by paulddraper 10y ago
Speaking of mature, well-built A/B test frameworks, Google Analytics uses multi-armed bandit.
https://support.google.com/analytics/answer/2844870?hl=en https://support.google.com/analytics/answer/2844870?hl=en
- mhoad 10y agoProbably worth mentioning that the Google Content Experiments framework is in the process of being replaced with Google Optimize (currently in a private beta) which does NOT make use of multi-armed bandits much to my confusion and disappointment.
- paulddraper 10y agoHuh. So do you know if they do anything help with repeat testing/peeking? Optimizely takes an interesting approach: they apply repeat testing methods, segmenting the tests by user views of the results. Like 30x more complicated than multi-bandit, but they don't need a feedback mechanism.