3 ms·
The repo uses RNN for Recursive Neural Network and specifically calls attention to its LSTM implementation.
by FreakLegion 10y ago
The repo uses RNN for Recursive Neural Network and specifically calls attention to its LSTM implementation.
- mrdrozdov 10y agoThanks for pointing this out. The same acronym is used to refer to both versions. I like the description of Recursive Neural Nets versus Recurrent Neural Nets in this Stack Overflow post [1]. > A recursive network is just a generalization of a recurrent network. In a recurrent network the weights are shared (and dimensionality remains constant) along the length of the sequence because how would you deal with position-dependent weights when you encounter a sequence at test-time of different length to any you saw at train-time. In a recursive network the weights are shared (and dimensionality remains constant) at every node for the same reason. In the TreeRNN (Tree Recursive Neural Nets) Github project and associated paper [2], there is indeed an implementation of a TreeLSTM which is a recursive LSTM inspired by the recurrent version. [1]: http://stats.stackexchange.com/a/158995/92040 http://stats.stackexchange.com/a/158995/92040 [2]: http://www.aclweb.org/anthology/P15-1150 http://www.aclweb.org/anthology/P15-1150