4 ms·
Unrelated. What matters for that is prompt processing time (which is in the high hundreds of tokens per second).
by redox99 3y ago
Unrelated. What matters for that is prompt processing time (which is in the high hundreds of tokens per second).
4 ms·