Nitpicking here, but while the authors do use a recurrent neural net (RNN), they do not use it exclusively. The system consists of a memory element, and a cont

Nitpicking here, but while the authors do use a recurrent neural net (RNN), they do not use it exclusively. The system consists of a memory element, and a controller element. In their evaluation of the system, they use both a standard feed-forward network, as well as an RNN with long short-term memory (LSTM) units as the controller element. In certain tasks, the feed-forward network works better. +1 on the deeplearning.net tutorials, and theano. I've learnt a lot from there.