5 ms·
No, actually much fewer tokens. 256 tokens cover all bytes. See the ByT5 paper: https://arxiv.org/abs/2105.13626 https://arxiv.org/abs/2105.13626
by Hendrikto 2y ago
No, actually much fewer tokens. 256 tokens cover all bytes. See the ByT5 paper: https://arxiv.org/abs/2105.13626 https://arxiv.org/abs/2105.13626