Right, it's a kind of bandit problem where you need to choose between exploration and exploitation. Continuing to use the toy that's working is not a bad solut

Right, it's a kind of bandit problem where you need to choose between exploration and exploitation. Continuing to use the toy that's working is not a bad solution. https://en.wikipedia.org/wiki/Multi-armed_bandit https://en.wikipedia.org/wiki/Multi-armed_bandit