4 ms·
What other use cases would use 128GB VRAM but not require higher throughput to run at acceptable speeds?
by gardnr 1y ago
What other use cases would use 128GB VRAM but not require higher throughput to run at acceptable speeds?
- Auracle 1y agoFine tuning text to image/video models perhaps? For the newest models unless you quantize the crap out of them, even with a 5090 you’re going to be swapping blocks, which slows things down anyways. At least you’d be able to train on them at full precision with a decent batch size. That said, I can’t imagine there’s enough of a market there to make it worth it.
- eadwu 1y agoPeople have done more with less for a long time (basically with the Jetson counterparts). The only likely difference with DGX Spark is that it'll be a more desktop-centered platform, what people can do with it, not sure, but say for VR, the DGX Spark is basically the best compute puck for one right now.