3 ms·
That's interesting. It's about the same speed as the M3 Max then. Have you tested it yourself?
by hmottestad 3y ago
That's interesting. It's about the same speed as the M3 Max then.
Have you tested it yourself?
- Manabu-eo 3y agoNope, but this guy has a similar build: https://www.reddit.com/r/LocalLLaMA/comments/1bt8kc9/comparing_the_performance_of_epyc_9374f_and/ https://www.reddit.com/r/LocalLLaMA/comments/1bt8kc9/compari... It seems to reach only a little above half the theoretical speed, and scale only up to 32 threads for some reason. Might be a temporary software limitation or something more fundamental.
- timschmidt 3y agoShould be at least twice the speed of the M3 Max, as the M3 CPU or GPU only get about half the memory bandwidth available to the package each. M3 Max can't take full advantage of it's memory bandwidth unless CPU, GPU, and NPU are all working at the same time.
- hmottestad 3y agoI tried looking for some info on this but could only find the M1 Max review over at anandtech that managed to push 200 GB/s when using multiple cores on the CPU, but couldn’t really get any numbers for just the GPU that seemed realistic. Do you have a source for the GPU only having access to half the bandwidth of the memory?