3 ms·
That presentation shows 194 gigabits/s which is only ~24 gigabytes/s at the NIC; that requires ~96 gigabytes/s of memory bandwidth. Usable memory bandwidth on M
by wmf 6y ago
That presentation shows 194 gigabits/s which is only ~24 gigabytes/s at the NIC; that requires ~96 gigabytes/s of memory bandwidth. Usable memory bandwidth on Milan is only <120 gigabytes/s which is about 60% of the theoretical max. DRAM never gets more than ~80% of theoretical max bandwidth because of command overhead (which is what I think ajross keeps alluding to). https://www.anandtech.com/show/16594/intel-3rd-gen-xeon-scalable-review/4 https://www.anandtech.com/show/16594/intel-3rd-gen-xeon-scal...
- dragontamer 6y agoI appreciate the correction. It seems like I made the mistake of Gbit vs GByte confusion (little-b vs big-B). > (which is what I think ajross keeps alluding to) It seems like ajross is accusing me of underestimating CPU-bandwidth. At least, that's my interpretation of the discussion so far. As you've pointed out however, I'm overestimating it. EDIT: But I'm overestimating it on both sides. A100 2000 TB/s is the "channel bandwidth" as well, as the CAS and RAS commands still need to go through the channel and get interpreted.