3 ms·
It's the opposite. Running lots of poorly optimized processes allows you to amortize memory latency. If your software suffers from cache misses then it's not go
by imtringued 6y ago
It's the opposite. Running lots of poorly optimized processes allows you to amortize memory latency. If your software suffers from cache misses then it's not going to run out of memory bandwidth any time soon. Adding more threads will increase memory bandwidth utilization. Meanwhile hyper optimized AVX512 code is going to max out memory bandwidth with a dozen cores or less.
- rbanffy 6y ago> it's not going to run out of memory bandwidth any time soon No, but the higher the memory bandwidth, the sooner those processes can get back to their inefficiency.
- CyberDildonics 6y agoThat's really not true. Memory bandwidth, just like memory capacity becomes a bottleneck when it is exceeded, but more doesn't automatically speed anything up. Java and python programs will likely be hopping around in memory and waiting on memory to make it to the CPU as a result. Typically only multiple cores running optimized software that will run through memory making heavy use of the prefetcher will exceed memory bandwidth.