4 ms·
Ah, that would be it. There's no way to tell you are heading to victory.
by degenerate 8y ago
Ah, that would be it. There's no way to tell you are heading to victory.
- PretzelPirate 8y agoShouldn’t the AI be rewarded for exploring places it hasn’t explored before? It seems like that would help it progress in Pitfall.
- Voloskaya 8y agoYes it's an active topic of research: https://openreview.net/pdf?id=rJNwDjAqYX https://openreview.net/pdf?id=rJNwDjAqYX
- jaster 8y agoThis is glossed upon in the article: "AI researchers have typically tried to get around the issues posed by by Montezuma’s Revenge and Pitfall! by instructing reinforcement-learning algorithms to explore randomly at times, while adding rewards for exploration—what’s known as “intrinsic motivation.” But the Uber researchers believe this fails to capture an important aspect of human curiosity. “We hypothesize that a major weakness of current intrinsic motivation algorithms is detachment,” they write. “Wherein the algorithms forget about promising areas they have visited, meaning they do not return to them to see if they lead to new states."