3 ms·
Exploration as the primary algorithm continues as long as we continue to get increasing variable rewards from it. When the rewards tapper off or we are pressure
by dzink 6y ago
Exploration as the primary algorithm continues as long as we continue to get increasing variable rewards from it. When the rewards tapper off or we are pressured for money, we choose the maximum we've found so far. This instinct to collect options has probably served us well in foraging for food, picking a mate, and any other exploration endeavor that involves finding the best of a range of newly available options.
However it may also be the root of gambling addiction and any other variable rewards game systems. Gambling, lotteries can also become more attractive the more you are pressured for money - one could argue as a means of concentrating on your most approachable local maximum.