2 ms·
Yhe main reason is speed. For example DDR5 has a transfer rate of about 50GB/s. The GDDR6X used in GPUs has a transfer rate of about 1TB/s. Nvidia just announce
by alargemoose 3y ago
Yhe main reason is speed. For example DDR5 has a transfer rate of about 50GB/s. The GDDR6X used in GPUs has a transfer rate of about 1TB/s. Nvidia just announced H200 AI processors have HBM3e memory that they report can go as fast at 10TB/s.