2 ms·
https://www.amd.com/system/files/documents/amd-cdna2-white-paper.pdf https://www.amd.com/system/files/documents/amd-cdna2-white-p... The article points out thi
by dragontamer 5y ago
https://www.amd.com/system/files/documents/amd-cdna2-white-paper.pdf https://www.amd.com/system/files/documents/amd-cdna2-white-p...
The article points out this CDNA2 whitepaper, which has the juicy technical details.
CDNA1 is here: https://www.amd.com/system/files/documents/amd-cdna-whitepaper.pdf https://www.amd.com/system/files/documents/amd-cdna-whitepap...
-----
CDNA2 / MI200 is a chiplet strategy with two "GCDs", each functioning as a classic GPU. These two GCDs can access each other's memory, but only at a lower 400GBps speed (page 8 whitepaper).
The actual HBM RAM is designed for 1600 GBps (article), x2 since two GCDs exist. AMD says its like 3200 GBps but in actuality, any one such block/workgroup can only get 2000 GBps (1600 GBps local RAM + 400 GBps from infinity-fabric / partner GCD). So its really a bit complicated and will likely be very workload specific.
If your data can be cloned / split efficiently, then the RAM probably will look like 3200GBps. But if you have to communicate with both parts of RAM to see all the data, you'll see a clear slowdown.