3 ms·
As the sibling comment says, there is work on this, but the key question becomes "how do you define novelty?" You could say new rooms are novel, but this is bas
by Eridrus 8y ago
As the sibling comment says, there is work on this, but the key question becomes "how do you define novelty?" You could say new rooms are novel, but this is basically just the engineering approach of defining a new reward, and isn't really an interesting solution since it's not really applicable to other RL use cases, or even other games.
- FartyMcFarter 8y ago> and isn't really an interesting solution since it's not really applicable to other RL use cases, or even other games. I think it applies to many games: you typically progress through different screens/levels/whatnot on your way to completing the game.
- dane-pgp 8y agoIn the worst case, the AI could store every single input it has received (for example, every frame it has seen) and calculate how similar each new input is to its past corpus. Calculating similarity of images is quite a well-understood problem, but you're right that generalising the idea of similarity across all types of input data, in a way that is helpful for the AI to learn from, and efficient to calculate, may end up requiring a lot of coding that's specific to the individual use case.