4 ms·
Only starts approaching PPL of AR at block size 4. May as well just use multi-token prediction with a standard AR model.
by hycpax 2y ago
Only starts approaching PPL of AR at block size 4. May as well just use multi-token prediction with a standard AR model.
- deleted 2y ago[deleted]