23 ms·
If I'm understanding this right, the AI wasn't given a "full demonstration" of the game, but specific frame snapshots at goal completion points. So it basically
by gfodor 8y ago
If I'm understanding this right, the AI wasn't given a "full demonstration" of the game, but specific frame snapshots at goal completion points. So it basically learned how to get from goal A to goal B, but it had to be given examples of what goal A and goal B looked like visually.
Iow, it was showing what beating the game would look like at some level of granularity. I guess the next obvious question is how far up you could dial the granularity and result in the AI still learning how to beat the game.
- Groxx 8y agoI read it as: "single demonstration" means they had a single run worth of data that they could train against however long they wanted. So they took that single play-through, chopped it up by room, and trained each room in reverse.