3 ms·
I thought it was strange that throughout is the same for CFP8 and BF16. Why support a fancy new 8 bit format if it's not faster than 16 bits? And there weren't
by modeless 5y ago
I thought it was strange that throughout is the same for CFP8 and BF16. Why support a fancy new 8 bit format if it's not faster than 16 bits? And there weren't any details about CFP8 so who knows what it really is.
- bagels 5y agoI think they said custom floating point?
- hencoappel 5y agoCould be more efficient than BF16?
- ericd 5y agoMemory usage?