4 ms·
Interesting token numbers they're using, because I've benchmarked it at 69 tok/s single steam and 130 multi stream.
by pants2 6mo ago
Interesting token numbers they're using, because I've benchmarked it at 69 tok/s single steam and 130 multi stream.