This is completely expected. If you look at multiarmed bandits, getting rewards would be exploiting and the other option is exploring. If you have a longer time

This is completely expected. If you look at multiarmed bandits, getting rewards would be exploiting and the other option is exploring. If you have a longer time horizon as children will, it is better to explore and find a better return than exploit something already known which is likely to be suboptimal.