4 ms·
> the N300 which has 2 chips per board with 4 boards in the system Ah my mistake, thanks for that. But also an H100 will definitely do more than 2000 t/s at b
by qeternity 2y ago
> the N300 which has 2 chips per board with 4 boards in the system
Ah my mistake, thanks for that.
But also an H100 will definitely do more than 2000 t/s at bs=32 in fp16