2 ms·Such as llama.cpp. It saturated memory bw while using only 6 of 8 cores on the xeon cpu i tried it on.by rini17 3y agoSuch as llama.cpp. It saturated memory bw while using only 6 of 8 cores on the xeon cpu i tried it on.