4 ms·
HBM are in very limited supply and NVidia tries to buy all the stock it could find at any price[1][2]. So the memory literally couldn't be increased. [1]: http
by YetAnotherNick 1y ago
HBM are in very limited supply and NVidia tries to buy all the stock it could find at any price[1][2]. So the memory literally couldn't be increased.
[1]: https://www.nextplatform.com/2024/02/27/he-who-can-pay-top-dollar-for-hbm-memory-controls-ai-training/ https://www.nextplatform.com/2024/02/27/he-who-can-pay-top-d...
[2]: https://www.reuters.com/technology/nvidia-clears-samsungs-hbm3-chips-use-china-market-processor-sources-say-2024-07-23/#:~:text=In%20contrast%20to%20Samsung%2C%20SK,will%20supply%20Nvidia%20with%20HBM3E. https://www.reuters.com/technology/nvidia-clears-samsungs-hb...
- WithinReason 1y agohow about GDDR?
- YetAnotherNick 1y agoIf bandwidth is not the issue, you could directly use system memory via PCIe[1]. No need for on chip memory. [1]: https://developer.nvidia.com/gpudirect https://developer.nvidia.com/gpudirect
- WithinReason 1y agobandwidth is almost always is an issue, but not enough to be worth buying dedicated HW for it.