3 ms·
CPU RAM is generally much slower. 8 channels of DDR4-3200 only provide 200GB/s bandwidth. RTX 3090 has 936GB/s. So even 4 socket Xeon won't catch up.
by lostmsu 4y ago
CPU RAM is generally much slower.
8 channels of DDR4-3200 only provide 200GB/s bandwidth. RTX 3090 has 936GB/s. So even 4 socket Xeon won't catch up.
- lmz 4y agoThat would only be an advantage if you had to do multiple passes over the data, otherwise the data would still go through the CPU RAM before getting loaded onto the GPU, no?
- lostmsu 4y agoDefinitely the case in the state of the art stuff like neural networks. Many if not most other algorithms are iterative. Hell, even sorting is.