4 ms·
Right, as I said, it can be done with frequentist statistics. This is what Optimizely does (http://pages.optimizely.com/rs/optimizely/images/stats_engine_techni
by paulddraper 10y ago
Right, as I said, it can be done with frequentist statistics. This is what Optimizely does (http://pages.optimizely.com/rs/optimizely/images/stats_engine_technical_paper.pdf http://pages.optimizely.com/rs/optimizely/images/stats_engin...). But (1) it is not simple and (2) it is not optimal.
---
Agreed 100% about multi-armed bandit which is what I was referring to. And the canonical solutions are in fact Bayesian :) See the Google Analytics link or lookup "Thompson sampling"
From your Wikipedia link:
"Probability matching strategies are also known as Thompson sampling or Bayesian Bandits, and surprisingly easy to implement if you can sample from the posterior for the mean value of each alternative."
- nickhuh 10y agoOh yeah there are a few Bayesian methods which work great, Bayes-UCB is another. Personally though I think KL-UCB or just plain old UCB would be the ones I'd choose. Like I said earlier, I think these techniques are like programming languages: choose the one you know well enough to get the job done with it.