3 ms·
Can you elaborate on the problem? The article claims support for dgx spark
by Scaled 2mo ago
Can you elaborate on the problem? The article claims support for dgx spark
- rsolva 2mo agoI have seen many a model card claim Spark compatibility, but without any proof or instructions. There are vibe-patched images of vLLM that kinda works with NVFP4 models, but I have not seen any support from NVIDIA. Does not seem to be a priority for some reason.
- Scaled 2mo agoThanks, I've been mulling over buying some of these so I appreciate the heads up.
- halfdeadcat 2mo agoAfter thrashing on it for a day, I could not get it going on DGX Spark with FP4 quantization. I find this irksome, since Nvidia created the NVFP4 specifically for Blackwell. The Nvidia cookbooks for this model are all for H100. I tried vLLM, Ollama and various patches. As of right now on DGX: you can feasibly do FP4 on dense models. But FP4 + MoE is a largely a dead-end.