3 ms·
Shouldn’t the AI be rewarded for exploring places it hasn’t explored before? It seems like that would help it progress in Pitfall.
by PretzelPirate 8y ago
Shouldn’t the AI be rewarded for exploring places it hasn’t explored before? It seems like that would help it progress in Pitfall.
- Voloskaya 8y agoYes it's an active topic of research: https://openreview.net/pdf?id=rJNwDjAqYX https://openreview.net/pdf?id=rJNwDjAqYX
- jaster 8y agoThis is glossed upon in the article: "AI researchers have typically tried to get around the issues posed by by Montezuma’s Revenge and Pitfall! by instructing reinforcement-learning algorithms to explore randomly at times, while adding rewards for exploration—what’s known as “intrinsic motivation.” But the Uber researchers believe this fails to capture an important aspect of human curiosity. “We hypothesize that a major weakness of current intrinsic motivation algorithms is detachment,” they write. “Wherein the algorithms forget about promising areas they have visited, meaning they do not return to them to see if they lead to new states."