2 ms·
This article is only about the tokenizer. It doesn't measure the number of tokens needed for each request, which could be higher or lower overall.
by Aurornis 7mo ago
This article is only about the tokenizer. It doesn't measure the number of tokens needed for each request, which could be higher or lower overall.