4 ms·
HBM is not lower latency than traditional DDR. It is significantly higher bandwidth, but the latency can be higher. On GPUs this is not a problem, because they
by arcanus 7y ago
HBM is not lower latency than traditional DDR. It is significantly higher bandwidth, but the latency can be higher. On GPUs this is not a problem, because they are quite latency tolerant. CPUs might have more trouble hiding the latency impact.
- hajile 7y agoYou are correct about HBM2 (latencies between 12 and 16ns vs 8-12ns latencies in typical DDR4 systems). My understanding was that HBM3 reduces those latencies and HBM4 potentially reduces them even further (in addition to lower latency due to closer proximity). AMD seems considers HBM on-chip to be an upcoming reality. https://www.guru3d.com/news-story/amd-working-on-vertical-(3d)-stacking-of-dram-onto-processors,2.html https://www.guru3d.com/news-story/amd-working-on-vertical-(3...