3 ms·
GPUs are in fact easier to reach high performance these days IMO. Sure, you gotta learn how to stride memory and possibly do it across workgroups, but those GPU
by dragontamer 5y ago
GPUs are in fact easier to reach high performance these days IMO. Sure, you gotta learn how to stride memory and possibly do it across workgroups, but those GPUs really have patterns that easily hit their specs (be it FLOPs or Memory Bandwidth)
GPUs are dumb, but that makes them kinda simpler for these kinds of simple tests.
CPUs, in particular the Thread ripper Pro, have very complex memory hierarchies.
Unless they experiment with NUMA mode (4 or 8 nodes maybe), I wouldn't expect much improvement. To max out the memory Bandwidth on a CPU, you really gotta understand MESI / cache snooping / false sharing, split up your accesses across the chip let's (easier to do with NUMA turned on) and code in a NUMA aware manner.
---------
I'm not saying GPUs are always better. But this particular test is really bloody simple and ideal for GPUs.
- ashvardanian 5y agoYeah, completely agree. Sadly we live in the convergence era. Now GPUs are also multi-chip (starting with MI200) and the latencies will likely become unpredictable once again :)