3 ms·
whats the difference between float16 and bfloat16?
by hwers 4y ago
whats the difference between float16 and bfloat16?
- brrrrrm 4y agonumber of exponent bits. bfloat16 has a larger dynamic range with lower precision. e.g. this would be infinity in fp16 https://float.exposed/b0x5f80 https://float.exposed/b0x5f80