3 ms·
Good reminder that raw tokens/sec numbers can be misleading without latency and context-window considerations.
by hiroakiaizawa 6mo ago
Good reminder that raw tokens/sec numbers can be misleading without latency and context-window considerations.