3 ms·
> single consumer-grade NVIDIA A6000 GPU with 48GB memory I wouldn't call an A6000 "consumer-grade" -- it's about $5000 and 99% of consumers that have graphics
by nacs 4y ago
> single consumer-grade NVIDIA A6000 GPU with 48GB memory
I wouldn't call an A6000 "consumer-grade" -- it's about $5000 and 99% of consumers that have graphics cards wouldn't have that.
Top of the line consumer grade GPU would be a Nvidia RTX 4090/3090 with 24GB VRAM.
- freeone3000 4y ago“Consumer grade” here means “you can buy it in a store”. (This is not true of DGX devices.)
- magicalhippo 4y agoSo "off the shelf" rather then.
- deleted 4y ago[deleted]
- coolspot 4y agoYour local MicroCenter doesn’t stock DGX A100/H100 ???
- teruakohatu 4y agoIt is solidly a workstation card that is often deployed in data centres. Consumers are far better off with a 4090.
- Tepix 4y agoAgreed, but two RTX 3090/4090 should be as capable in this regard (having 2x 24GB).
- alwayslikethis 4y agoIs it? It might have even more computing power, but are cards now able to share VRAM now? My hands-on experience of all this is from a few years ago and I think it was not possible back then.
- Tepix 4y agoDeepSpeed is designed to take care of spreading the work for you. You can link two 3090s with nvlink to increase bandwidth.
- mejutoco 4y agoAFAIK the 4090 cannot share ram like that (no nvlink)