3 ms·
The article talks about the difference in the pre-fetcher between the two neoverse setups (Graviton and Grace Hopper). However isn’t the prefetcher part of the
by dagmx 2y ago
The article talks about the difference in the pre-fetcher between the two neoverse setups (Graviton and Grace Hopper). However isn’t the prefetcher part of the core design in neoverse? How would they differ?
- MobiusHorizons 2y agoI believe the difference is in the cache hierarchy (more l3 less l2) and generally high latency to dram even higher latency to hbm. This makes the prefetcher behave differently between the two implementations, because the l2 cache isn’t able to absorb the latency
- dagmx 2y agoThat was my initial read but they have this line which made me wonder if it was somehow more than that > I suspect Grace has a very aggressive prefetcher willing to queue up a ton of outstanding requests from a single core.
- MobiusHorizons 2y agoOh good point, maybe that is configurable as well.