4 ms·
Perhaps NVIDIA or somebody could invent a RAM upgrade via NVLINK? Seems plausible and not every problem would want to add another GPU when the ability to add t
by Zenst 3y ago
Perhaps NVIDIA or somebody could invent a RAM upgrade via NVLINK? Seems plausible and not every problem would want to add another GPU when the ability to add the extra memory alone is all they need.
- wongarsu 3y agoBut why would NVIDIA do that when they can just sell you an A100 for ten times the price of a 4090?
- margorczynski 3y agoWe need AMD to compete, but from what I know their software is subpar to NVIDIA's offering and most of the current ML stacks are built around CUDA. Still there's a lot of money to be made in this area now so competition big and small should pop up.
- idonotknowwhy 3y agoI'd love it if AMD and Intel teamed up to make a wrapper layer for CUDA. Surely they'd both benefit greatly.
- versteegen 3y agoFirst Intel and then AMD funded a wrapper, yes. Unfortunately the new version supports AMD but no longer Intel. https://github.com/vosen/ZLUDA https://github.com/vosen/ZLUDA That's a binary level wrapper. Of course there's also ROCm HIP at the source level, and many other things, such as SYCL
- dragonwriter 3y agoIn a hypothetical near-future world, competition?
- dacryn 3y agothe memory is inherent to the gpu architecture. You cannot just add VRAM and expect no other bottlenecks to pop up. Yes they can reduce the VRAM to create budget models and save a bit here and there. But adding VRAM to a top model is a tricky endeavour
- Animats 3y agoThere is a mini-industry in China buying old NVidia GPUs, upgrading the memory, and reselling them.
- devit 3y agoWhat's the best that can be achieved with this method?
- Animats 3y ago2X. Converting old NVidia 2080s from 11GB to 22GB. [1] [1] https://www.tomshardware.com/pc-components/gpus/chinese-workshops-recondition-nvidias-old-flagship-gaming-gpu-for-ai-rtx-2080-ti-upgraded-to-22gb-for-dollar499 https://www.tomshardware.com/pc-components/gpus/chinese-work...