3 ms·
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.
by beffjezos 5mo ago
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.
3 ms·