2 ms·
see the long range performance piece here https://arxiv.org/pdf/2401.04088.pdf https://arxiv.org/pdf/2401.04088.pdf
by twobitshifter 3y ago
see the long range performance piece here
https://arxiv.org/pdf/2401.04088.pdf https://arxiv.org/pdf/2401.04088.pdf
- Johnyjohnson123 3y agoI don't think they explain it in the paper, do they? They just mention the result it seems. I am really curious to know too. Maybe they imply it's the result of their Mixture Of Experts architecture? Or maybe they just don't wanna say, idk