3 ms·
i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
by jebarker 2y ago
i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
- whimsicalism 2y ago<think> might be i think "wait" is tokenized like any other in the pretraining