3 ms·
I'd say that bandwidth matters less than latency for performance. Both are good, but this is part of the reason why we see ever-increasing cache sizes, and memo
by MayeulC 3y ago
I'd say that bandwidth matters less than latency for performance. Both are good, but this is part of the reason why we see ever-increasing cache sizes, and memory physically closer to the CPU.
Edit: Of course, it depends on the benchmark. Latency is critical for programs that access many memory addresses randomly, not for data processing applications that scan memory linearly (and GPU use-cases often fall into that category).