2 ms·
> On 2x RTX Pro 6000 Blackwell, its ~8k tok/s prefill and ~250 tok/s on a single stream. For reference, on a 1x B300 it's over 400 tok/s decode on a single str
by kouteiheika 2mo ago
> On 2x RTX Pro 6000 Blackwell, its ~8k tok/s prefill and ~250 tok/s on a single stream.
For reference, on a 1x B300 it's over 400 tok/s decode on a single stream.