3 ms·
As I suggested in http://bentilly.blogspot.com/2012/09/ab-testing-vs-mab-algorithms-its.html http://bentilly.blogspot.com/2012/09/ab-testing-vs-mab-algor... you
by btilly 14y ago
As I suggested in http://bentilly.blogspot.com/2012/09/ab-testing-vs-mab-algorithms-its.html http://bentilly.blogspot.com/2012/09/ab-testing-vs-mab-algor... you can use a MAB algorithm with a forgetting factor for this. I've actually done it with a more sophisticated system, but the idea is similar - boost whatever you have evidence is performing better right now. (You should put in logic to avoid time-based fluctuations in performance throwing you off.)
The one that I built had minor teething pains, but it is now working quite well. And it is convenient to be able to every so often drop in new versions, and remove ones which have proven unable to perform up to snuff even with a newness effect, and just trust that it will Do The Right Thing.