4 ms·
Memory bandwidth and memory size. Along with power/cooling density. Hence why you see AMD's MI325x coming out with 256GB HBM3e, but it is the same FLOPs as a 3
by latchkey 2y ago
Memory bandwidth and memory size. Along with power/cooling density.
Hence why you see AMD's MI325x coming out with 256GB HBM3e, but it is the same FLOPs as a 300x. 6TB/s too, which outperforms H200's, by a lot.
You can see the direction AMD is going with this...
https://www.amd.com/en/products/accelerators/instinct/mi300/mi325x.html https://www.amd.com/en/products/accelerators/instinct/mi300/...