3 ms·
It's very rare that software is able to use all the memory bandwidth on a CPU. Something well written with multiple cores is where you will see it happen and th
by CyberDildonics 3y ago
It's very rare that software is able to use all the memory bandwidth on a CPU. Something well written with multiple cores is where you will see it happen and that's why higher core counts can often have more memory lanes.
- deleted 3y ago[deleted]
- rini17 3y agoSuch as llama.cpp. It saturated memory bw while using only 6 of 8 cores on the xeon cpu i tried it on.