3 ms·
Love this kind of experiment. Would the model perform better with word tokens?
by ricardobeat 6mo ago
Love this kind of experiment. Would the model perform better with word tokens?
- encrux 6mo agoA friend of mine forked the repo and tried it with BPE (Byte-Pair Encodings), and it did noticeably improve performance.