5 ms·

> 32MB L3 Cache is going to be very useful for certain types of Application. Are there applications where more cache is actively detrimental?

foota 6y ago
No? Other than the next best use of that silicon/heat budget, to whatever degree the latter is relevant for cache. But not afaik from an architectural point of view.
phire 6y ago
General rule of thumb is that bigger caches are slower to access. If AMD have traded a bit of access latency for their larger cache, then theoretically there will be a memory heavy application with a working set that fits in 16MB that will see a preformance hit. Though, we don't know Zen 2 was running into area based speed limitations for it's L3 cache. It's entirely possible Zen 3's cache runs at the same speed.
- shaklee3 6y ago
  Slower, but always faster than dram. So no, there are no downsides.
  - wolrah 6y ago
    A larger but slower cache would be a downside for an application that did not need the extra capacity. Now it's cache accesses are slower with no gains anywhere else. Of course if you don't have enough memory at a given tier and are overflowing in to the next adding more will always make things better, but once you hit that point adding more just adds cost at best and might actually make things worse if it's slower for the extra capacity.
  - Entalpi 6y ago
    There are a bunch of downsides to large caches. Everything from access time to chip layout to latency and even power consumption. Everything cant be cache and be awesome.. :P
rnvannatta 6y ago
Having more cache can potentially lower the speed of the cache, as the access time is limited by the time the longest path takes, the propagation delay. So there's a tradeoff between cache size and cache speed, which is why there are separate L1, L2, and L3 caches of various sizes. So potentially the L3 cache in this architecture could be slower than the L3 cache in the 3000 series. It could also be the same speed if the size was limited for other reasons, such as yield.
- formerly_proven 6y ago
  AMD claims a significant improvement in memory latency though, which is concordant with their large gains in gaming workloads (a 20 % general-purpose-throughput-oriented IPC increase alone would never give you a 20 % FPS increase in games).
  - rnvannatta 6y ago
    A larger cache size would improve memory latency assuming the working set can utilize the full 36mb, which I'm sure the 2 games that had a 20% uplift can. It's purely speculation but I suspect the cache size was limited by yield concerns rather than timing constraints. It looks like the 5600X has 1mb less cache so they probably engineered a way to disable faulty sections of the cache on a 1mb granularity. Edit: My speculation's wrong. The cache difference between the 5700X and the 5600X is due to core count differences. It's the sum of the various cache sizes, and I misread the slide.
  - Sohcahtoa82 6y ago
    > a 20 % general-purpose-throughput-oriented IPC increase alone would never give you a 20 % FPS increase in games Is this true even for games that are CPU-bound? When I play MS Flight Simulator, enable the Dev toolbar, and look at the framerate monitor, it tells me that it's spending 20 ms of CPU time per frame, which causes my framerate to cap at 50 fps. A 20% increase in IPC would theoretically bring the frame time to 16.67 ms, giving me a cap of 60 fps.
    - deleted 6y ago
sedatk 6y ago
There probably are in which more cache is useless.
- wolrah 6y ago
  Exactly. All else being equal more memory is either neutral or better, but all else is not always equal. If the larger capacity memory is slower, then any applications that didn't need more memory just lost performance.
wmf 6y ago
Not as such, but larger caches are slower (due to the speed of light) which can reduce performance. A few apps have seen performance regressions on Tiger Lake.
- alecmg 6y ago
  Cache access times are measured in nanoseconds. Light nanosecond ((c) Grace Hopper) is ~30cm
- tylerhou 6y ago
  > but larger caches are slower (due to the speed of light) Wouldn't it be more accurate to say due to gate delay because of an additional level in (de)muxing?
  - wmf 6y ago
    I assumed the slowdown is due to wire delay (a larger cache has longer wires) not gate delay but I could be wrong.

foota 6y ago

No? Other than the next best use of that silicon/heat budget, to whatever degree the latter is relevant for cache. But not afaik from an architectural point of view.

phire 6y ago

General rule of thumb is that bigger caches are slower to access. If AMD have traded a bit of access latency for their larger cache, then theoretically there will be a memory heavy application with a working set that fits in 16MB that will see a preformance hit. Though, we don't know Zen 2 was running into area based speed limitations for it's L3 cache. It's entirely possible Zen 3's cache runs at the same speed.

shaklee3 6y ago
Slower, but always faster than dram. So no, there are no downsides.
- wolrah 6y ago
  A larger but slower cache would be a downside for an application that did not need the extra capacity. Now it's cache accesses are slower with no gains anywhere else. Of course if you don't have enough memory at a given tier and are overflowing in to the next adding more will always make things better, but once you hit that point adding more just adds cost at best and might actually make things worse if it's slower for the extra capacity.
- Entalpi 6y ago
  There are a bunch of downsides to large caches. Everything from access time to chip layout to latency and even power consumption. Everything cant be cache and be awesome.. :P

rnvannatta 6y ago

Having more cache can potentially lower the speed of the cache, as the access time is limited by the time the longest path takes, the propagation delay. So there's a tradeoff between cache size and cache speed, which is why there are separate L1, L2, and L3 caches of various sizes. So potentially the L3 cache in this architecture could be slower than the L3 cache in the 3000 series. It could also be the same speed if the size was limited for other reasons, such as yield.

formerly_proven 6y ago
AMD claims a significant improvement in memory latency though, which is concordant with their large gains in gaming workloads (a 20 % general-purpose-throughput-oriented IPC increase alone would never give you a 20 % FPS increase in games).
- rnvannatta 6y ago
  A larger cache size would improve memory latency assuming the working set can utilize the full 36mb, which I'm sure the 2 games that had a 20% uplift can. It's purely speculation but I suspect the cache size was limited by yield concerns rather than timing constraints. It looks like the 5600X has 1mb less cache so they probably engineered a way to disable faulty sections of the cache on a 1mb granularity. Edit: My speculation's wrong. The cache difference between the 5700X and the 5600X is due to core count differences. It's the sum of the various cache sizes, and I misread the slide.
- Sohcahtoa82 6y ago
  > a 20 % general-purpose-throughput-oriented IPC increase alone would never give you a 20 % FPS increase in games Is this true even for games that are CPU-bound? When I play MS Flight Simulator, enable the Dev toolbar, and look at the framerate monitor, it tells me that it's spending 20 ms of CPU time per frame, which causes my framerate to cap at 50 fps. A 20% increase in IPC would theoretically bring the frame time to 16.67 ms, giving me a cap of 60 fps.
  - deleted 6y ago

sedatk 6y ago

There probably are in which more cache is useless.

wolrah 6y ago
Exactly. All else being equal more memory is either neutral or better, but all else is not always equal. If the larger capacity memory is slower, then any applications that didn't need more memory just lost performance.

wmf 6y ago

Not as such, but larger caches are slower (due to the speed of light) which can reduce performance. A few apps have seen performance regressions on Tiger Lake.

alecmg 6y ago
Cache access times are measured in nanoseconds. Light nanosecond ((c) Grace Hopper) is ~30cm
tylerhou 6y ago
> but larger caches are slower (due to the speed of light) Wouldn't it be more accurate to say due to gate delay because of an additional level in (de)muxing?
- wmf 6y ago
  I assumed the slowdown is due to wire delay (a larger cache has longer wires) not gate delay but I could be wrong.