4 ms·
A single MI300x has 192GB of vram.
by latchkey 1y ago
A single MI300x has 192GB of vram.
- ElectricalUnion 1y agoSad reality is that the MI300x isn't a monolithic die, so the chiplets have internal bandwidth limitations (ofc less severe that using PCIe/nvlink). In AMD own parlance, the "Modular Chiplet Platform" presents itself as either single-I-don't-care-about-speed-or-latency "Single Partition X-celerator" mode or in multiple-I-actually-totally-do-care-about-speed-and-latency-NUMA-like "Core Partitioned X-celerator" mode. So you kinda still need to care what-loads-where.
- latchkey 1y agoI have never heard of a GPU where a deep understanding of how memory is managed was not critical towards getting the best performance.