3 ms·
Notwithstanding the memory complexity, I love that they reach such impressive results with relatively straightforward components: theres no attention mechanism,
by isoprophlex 8y ago
Notwithstanding the memory complexity, I love that they reach such impressive results with relatively straightforward components: theres no attention mechanism, and encoding into latent space is simply max pooling over the last LSTM layer.
I don't fully understand how the training step works though. They train only on translation to english and Spanish?
Anyway very cool stuff.