3 ms·
What would matter more is the token length, depends how well your tokenizer was trained on french I guess.
by ViscountPenguin 2mo ago
What would matter more is the token length, depends how well your tokenizer was trained on french I guess.
3 ms·