4 ms·
Memory move is the bottleneck these days, thus the expensive HBM, Nvidia's design is also memory-optimized since it's the true bottleneck chip wise and system w
by synergy20 2y ago
Memory move is the bottleneck these days, thus the expensive HBM, Nvidia's design is also memory-optimized since it's the true bottleneck chip wise and system wise.
- DrNosferatu 2y agoWhy haven’t all GPUs migrated to HBMx? You seldom see it.
- iml7 2y agoexpensive
- deepnotderp 2y agoIt’s expensive, not needed for most consumer workloads and ironically, is actually often worse for latency for many patterns, even though it’s much higher bandwidth
- ska 2y agowhy is that ironic? Many ways to increase bandwidth come at the cost of latency...