3 ms·
> If your knowledge base is smaller than 200,000 tokens (about 500 pages of material) I would prefer that anthropic just release their tokeniser so we don't ha
by msp26 2y ago
> If your knowledge base is smaller than 200,000 tokens (about 500 pages of material)
I would prefer that anthropic just release their tokeniser so we don't have to make guesses.
- whereismyacc 2y agoshouldn't this be possible to reverse-engineer since they stream the responses token-by-token?