3 ms·
MI355X can perform FP6 operations with the same speed as their FP4 (unique to AMD) - people should be making MXFP6 quants which would be pretty much lossless, a
by unrvl22 5mo ago
MI355X can perform FP6 operations with the same speed as their FP4 (unique to AMD) - people should be making MXFP6 quants which would be pretty much lossless, and much closer to FP4 performance than FP8
- Hugsun 5mo agoThat can only be true if the workload is compute bound, not memory bandwidth bound.