4 ms·
Claude Opus 4.7's new tokenizer: 1.47x on English, 1.01x on Chinese
- trevwebdev 5mo agointeresting, i wonder about visual tokenization since it says it's much better at that ... especially with how claude in chrome is becoming more of my work flow
- aray07 5mo agogood point - i analyzed text tokenization. will run some experiments to see how visual tokenization has changed