4 ms·
There has been some innovation, e.g. SuperBPE (https://arxiv.org/abs/2503.13423 https://arxiv.org/abs/2503.13423) claims substantial gains on 8B-sized models.
by woodson 1y ago
There has been some innovation, e.g. SuperBPE (https://arxiv.org/abs/2503.13423 https://arxiv.org/abs/2503.13423) claims substantial gains on 8B-sized models.