3 ms·
https://arxiv.org/abs/2404.08819 https://arxiv.org/abs/2404.08819
by lucidrains 3y ago
https://arxiv.org/abs/2404.08819 https://arxiv.org/abs/2404.08819
- deleted 3y ago[deleted]
- Der_Einzige 3y agoSo does anything do proper state tracking? And don’t point to the OP since very often purportedly better new architectures end up being basically vaporware (like mamba or rkwv, which still don’t have good quality pre trained models yet)
- impossiblefork 3y agoHow do you mean vaporware? Surely whether a big model using a certain system exists is only a matter of the choices of those with sufficient resources to train it. That's only a matter of their beliefs, not about actual model performance.