4 ms·
Aren't 288 cores with low cache going to be memory-starved with 12 channels?
by treprinum 2y ago
Aren't 288 cores with low cache going to be memory-starved with 12 channels?
- londons_explore 2y agomaybe being memory bandwidth starved is intentional? Cores are relatively cheap these days (not much silicon area, power proportional to instructions processed). Whereas cache uses a lot of silicon area (expensive), and memory bandwidth/data transfer costs power. Speculative memory reads trade lots of memory bus capacity and power for performance. Therefore, for maximum compute per watt and compute per dollar, you probably want excess cores and to make sure you fully utilize any cache and memory bandwidth. You don't do much speculative read-ahead and you accept lower per-core performance to get more throughput per dollar.
- treprinum 2y agoThat would be great for some homogeneous HPC workloads but I fail to see how that would help cloud providers renting individual cores, each on a different unrelated workload.