3 ms·
Eight B200s, at whatever quantization I can fit, ideally fp4. Apparently it might fit in eight H200s, but with 2.8B parameters (1.8% active) I'm not optimistic.
by Y_Y 2mo ago
Eight B200s, at whatever quantization I can fit, ideally fp4. Apparently it might fit in eight H200s, but with 2.8B parameters (1.8% active) I'm not optimistic.