3 ms·
I can't find any information that show a difference as large as 2x. Do you have a specific comparison point in mind? From Nvidia and AMD, I read sparse fp8 at
by ebalit 2y ago
I can't find any information that show a difference as large as 2x. Do you have a specific comparison point in mind?
From Nvidia and AMD, I read sparse fp8 at 7 PFLOPs for B100 [0] vs 5.22 PFLOPs for mi325x [1]
Nvidia doesn't give the dense fp8 so that's the easiest comparison I could get.
[0] https://resources.nvidia.com/en-us-blackwell-architecture https://resources.nvidia.com/en-us-blackwell-architecture
[1] https://www.amd.com/en/products/accelerators/instinct/mi300/mi325x.html https://www.amd.com/en/products/accelerators/instinct/mi300/...