2 ms·
That's only because they didn't use recurrent neural networks which save information over time. RNNs make it possible to play games with hidden state. Deepmind
by Houshalter 10y ago
That's only because they didn't use recurrent neural networks which save information over time. RNNs make it possible to play games with hidden state. Deepmind is currently working on that with starcraft, which is vastly more complicated than pacman. They also have some work on 3d games like doom.
A few weeks ago there was a paper posted on "Synthetic Gradients" which should make it much more practical to train RNNs for games. Before it required saving every single computation the computer makes to memory, which uses a huge amount of memory and computation. Using synthetic gradients they need only store a few steps in the past. And it can learn online.