4 ms·
FP16 has 11 bit mantiassa, whereas FP64 has 53 bits. Integer multiplication scales quadratically with the number of bits, so a factor of ~23 might be more accur
by johndough 8y ago
FP16 has 11 bit mantiassa, whereas FP64 has 53 bits. Integer multiplication scales quadratically with the number of bits, so a factor of ~23 might be more accurate.