Even still, AIs are not able to "figure out" exploration heavy games, like montezuma's revenge [1] I suspect games that will give ai the most trouble: games wi

Even still, AIs are not able to "figure out" exploration heavy games, like montezuma's revenge [1] I suspect games that will give ai the most trouble: games with super sparse signals or ambiguous directions (others mention RPGs, and that tracks) Games that are hard to simulate will be hard from a training perspective (I think both starcraft and dota2 needed patches to give the AIs reasonable tools to understand the game) At one point, before go was solved, it seemed like maybe adding significant depth or randomness to a game might make it "hard", but now I'm more convinced that difficulty simulating & exploring tends to be a bigger factor [1] https://openai.com/blog/learning-montezumas-revenge-from-a-single-demonstration/ https://openai.com/blog/learning-montezumas-revenge-from-a-s... It gets it but hard to make a general ai that understands it and the other atari games