3 ms·
MI355X can perform FP6 operations with the same speed as their FP4 (unique to AMD) - people should be making MXFP6 quants which would be pretty much lossless, a
by unrvl22 3mo ago
MI355X can perform FP6 operations with the same speed as their FP4 (unique to AMD) - people should be making MXFP6 quants which would be pretty much lossless, and much closer to FP4 performance than FP8
- Hugsun 3mo agoThat can only be true if the workload is compute bound, not memory bandwidth bound.