4 ms·
You got it backwards; it's ~200 on single stream so the 2,600 is achieved with ~13 streams.
by wmf 3mo ago
You got it backwards; it's ~200 on single stream so the 2,600 is achieved with ~13 streams.
- beffjezos 3mo agoYeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.