4 ms·
https://arxiv.org/abs/2404.08819 https://arxiv.org/abs/2404.08819
by lucidrains 2y ago
https://arxiv.org/abs/2404.08819 https://arxiv.org/abs/2404.08819
- deleted 2y ago[deleted]
- Der_Einzige 2y agoSo does anything do proper state tracking? And don’t point to the OP since very often purportedly better new architectures end up being basically vaporware (like mamba or rkwv, which still don’t have good quality pre trained models yet)
- impossiblefork 2y agoHow do you mean vaporware? Surely whether a big model using a certain system exists is only a matter of the choices of those with sufficient resources to train it. That's only a matter of their beliefs, not about actual model performance.