4 ms·
But the point of such a machine generally is to have the equivalent of a GB300 NVL72 tray on your desk. It's so that you can do the work that belongs in a produ
by cmrdporcupine 1mo ago
But the point of such a machine generally is to have the equivalent of a GB300 NVL72 tray on your desk. It's so that you can do the work that belongs in a production DC eventually. Or at least that's now NVIDIA would like you to use it.
You could build out a complicated multi GPU setup of your own, but the work you do on inference tuning for your kernels etc would not necessarily translate to the real world.
But yes, if you just want to run GLM 5.3 on your own machine, that's a whole other story.
- rbanffy 1mo ago> Or at least that's now NVIDIA would like you to use it. Exactly. It's tailor-built to be a GB300 tray under your desk. Unless you really need a GB300 tray under your desk, you would be better served looking elsewhere.