4 ms·
Do you know how much 'state' DeepMind is tracking? Is it just choosing the best action given perceptions at the moment, or does it have some level of memory to
by jbattle 12y ago
Do you know how much 'state' DeepMind is tracking? Is it just choosing the best action given perceptions at the moment, or does it have some level of memory to work from? I wonder how DeepMind would do at path-finding in a maze for example - would it get stuck in an oscillating state?
- shmageggy 12y agoTheir algorithm uses a sequence of four slightly spaced out frames as its state. So it has a memory, but a very short one. It could probably solve a maze quite easily if the entire maze fit on screen. That problem requires no memory. If it had to make decisions based on information not present on screen, it would fail.