4 ms·
The hard-coded dictionary wouldn't be much stranger than Brotli's: https://news.ycombinator.com/item?id=27160590 https://news.ycombinator.com/item?id=27160590
by Rendello 10mo ago
The hard-coded dictionary wouldn't be much stranger than Brotli's:
https://news.ycombinator.com/item?id=27160590 https://news.ycombinator.com/item?id=27160590
- maxbond 10mo agoYou can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.