3 ms·
You know what's also faster to roughly get the amount of tokens? string.length/5
by janwilmake 1y ago
You know what's also faster to roughly get the amount of tokens? string.length/5
- deleted 1y ago[deleted]
- _flux 1y agoIt is not helpful in actual tokenization, though.