2 ms·
What hardware are you expecting to run K3 on?
by nojs 2mo ago
What hardware are you expecting to run K3 on?
- Y_Y 2mo agoEight B200s, at whatever quantization I can fit, ideally fp4. Apparently it might fit in eight H200s, but with 2.8B parameters (1.8% active) I'm not optimistic.