2 ms·
Plain RNNs are theoretically weaker than transformers with COT: https://arxiv.org/abs/2402.18510 https://arxiv.org/abs/2402.18510 .
by logicchains 2y ago
Plain RNNs are theoretically weaker than transformers with COT: https://arxiv.org/abs/2402.18510 https://arxiv.org/abs/2402.18510 .
- tossandthrow 2y agoThe paper says transformers perform better than RNNs, which is not surprising. However, they are both, theoretically, Turing complete computers. So they are equally expressive.