I observed this phenomena not too long ago while training an RL agent to play pokemon using an intrinsic novelty reward based on the number of unique screens th

I observed this phenomena not too long ago while training an RL agent to play pokemon using an intrinsic novelty reward based on the number of unique screens the agent had seen. The goal was to get it to explore the map, but instead it became fixated watching animated water, flowers, and npcs in the starting town. I made an extensive video analyzing the experiments, you can find it by searching "ai plays pokemon" :)