5 ms·
GP is talking about context windows, not the number of token used by the tokenizer.
by littlestymaar 2y ago
GP is talking about context windows, not the number of token used by the tokenizer.
- sva_ 2y agoSomewhat confusingly, it appears the tokenizer vocabulary as well as the context length are both 128k tokens!
- littlestymaar 2y agoYup, that's why I wanted to clarify things.