3 ms·
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.
by beffjezos 3mo ago
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.
3 ms·