3 ms·
Yes, next token prediction is exactly what you need for compression. Many papers on this, recent one https://arxiv.org/pdf/2309.10668.pdf https://arxiv.org/pdf
by atorodius 3y ago
Yes, next token prediction is exactly what you need for compression. Many papers on this, recent one
https://arxiv.org/pdf/2309.10668.pdf https://arxiv.org/pdf/2309.10668.pdf
- sdenton4 3y agoLovely paper, thanks!