3 ms·
> EPYCs seem to have more like 250GB/s max Your link goes to info on the 2022 EPYC CPUs, the current generation can do 576GB/s: https://chipsandcheese.com/p/am
by ac29 2y ago
> EPYCs seem to have more like 250GB/s max
Your link goes to info on the 2022 EPYC CPUs, the current generation can do 576GB/s: https://chipsandcheese.com/p/amds-turin-5th-gen-epyc-launched https://chipsandcheese.com/p/amds-turin-5th-gen-epyc-launche...
Intel's current 12ch Xeons should be even faster with MRDIMMs, though I couldnt find a memory specific benchmark.
- magicalhippo 2y agoAh shoot, that's what one gets for being in a hurry and on the phone. Saw the date of the article and mention of the EPYC 9004, but forgot that it's the 9005 that's the new series and missed the details. Thanks for the correction. edit: found a llama.cpp issue discussing performance bottlenecks on modern dual-socket EPYC here[1]. Also includes single-socket benchmarks, and includes some optimizations. Just thought it was interesting. [1]: https://github.com/ggml-org/llama.cpp/discussions/11733 https://github.com/ggml-org/llama.cpp/discussions/11733