3 ms·
What do you mean by "kneecapped for training"? Isn't it 128GB of VRAM enougth for small model training, that a current GC can't do? Obviously, even with connec
by _ache_ 1y ago
What do you mean by "kneecapped for training"?
Isn't it 128GB of VRAM enougth for small model training, that a current GC can't do?
Obviously, even with connectx, it's only 240Gi of VRAM, so no big models can be trained.
- monster_truck 1y agoSpend some time looking at the real benchmarks before writing nonsense
- _ache_ 1y agoYou are quite rude here. I was asking questions. The benchmarks are very new and don't explains why it can used for training. But if FP4 means 4bit floating point, and that the hardware capability of the DGX Spark is effectively only in FP4, then yes. That was nonsense to wish it could have been used for training. But it wasn't obvious from the advertising of nvidia.