4 ms·
Not going to happen: https://www.servethehome.com/wp-content/uploads/2022/08/NVIDIA-Grace-Bandwidth-HBM2e-DDR5-LPDDR5x-HC34.jpg https://www.servethehome.com/wp
by my123 4y ago
Not going to happen:
https://www.servethehome.com/wp-content/uploads/2022/08/NVIDIA-Grace-Bandwidth-HBM2e-DDR5-LPDDR5x-HC34.jpg https://www.servethehome.com/wp-content/uploads/2022/08/NVID...
That unless an utterly revolutionary new interconnect technology comes...
LPDDR is getting adopted more and more too, with CPUs losing memory expansion capabilities in exchange of huge power savings.
- amelius 4y agoI bet a lot of people would be happy if their GPU could train large models, even if it took 5x as long.
- my123 4y agoThat's getting a multi-level DRAM config, see Grace Superchip for an example. Or just a plain slower GPU: Apple's GPU series, but that's at very much higher price tags than desktop GPUs at a given perf level.