There are also limits to the sequence to sequence things they can effectively learn, in some cases weaker than LSTMs: https://arxiv.org/abs/2207.02098 https://

There are also limits to the sequence to sequence things they can effectively learn, in some cases weaker than LSTMs: https://arxiv.org/abs/2207.02098 https://arxiv.org/abs/2207.02098