3 ms·
Talking about "speed" is confusing. The problem is not a bandwidth bottleneck, but a latency bottleneck. Having cache doesn't always solve this problem. If an
by gnode 7y ago
Talking about "speed" is confusing. The problem is not a bandwidth bottleneck, but a latency bottleneck.
Having cache doesn't always solve this problem. If an application requires random memory access over a range much larger than the cache, then it will fall down on the latency of main RAM.
- Dylan16807 7y agoThe latency bottleneck came into existence decades ago. It's not a wall. And it's not getting much worse, because it's impossible to squeeze many more GHz out of silicon. What's happening from Moore's Law is that we get more transistors, and make more cores, which causes a bandwidth bottleneck. But you can fix that by keeping a fixed ratio of math units to memory channels. It's also not a wall.