4 ms·
Timings are much less important for GPUs than bandwidth; the cores are slow and doing the same work on similar memory. A 3090 has ~270ns of memory latency - <70
by ben-schaaf 3y ago
Timings are much less important for GPUs than bandwidth; the cores are slow and doing the same work on similar memory. A 3090 has ~270ns of memory latency - <70ns is normal for a CPU. See https://chipsandcheese.com/2021/05/13/gpu-memory-latencys-impact-and-updated-test/ https://chipsandcheese.com/2021/05/13/gpu-memory-latencys-im...
- jorvi 3y agoMaybe I’m misunderstanding the article, but there’s multiple places where they mention memory latency being the main bottleneck. At any rate, thanks for sharing! Interesting stuff.
- lynguist 3y agoNo, it’s really bandwidth. Big GPUs have on the order of 800 GB/s memory bandwidth and big CPUs only 80 GB/s! Except for Apple. They really need to up the bandwidth. GPU performance is proportional to both bandwidth and compute.