> But with Attention mechanism I would think LeCun was aware of that. Also prior sequence to sequence models like RNNs have already incorporated information ab

> But with Attention mechanism I would think LeCun was aware of that. Also prior sequence to sequence models like RNNs have already incorporated information about the further past.