4 ms·
Interesting release from Apple but there's been a similar (and I think more promising architecturally) paper from Meta lately: > MEGABYTE: Predicting Million-b
by airgapstopgap 3y ago
Interesting release from Apple but there's been a similar (and I think more promising architecturally) paper from Meta lately:
> MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
https://arxiv.org/abs/2305.07185 https://arxiv.org/abs/2305.07185