4 ms·It’s by far the most popular data type for training neural networks.by NavinF 4y agoIt’s by far the most popular data type for training neural networks.brrrrrm 4y agofor lack of bfloat16 supporthwers 4y agowhats the difference between float16 and bfloat16?brrrrrm 4y agonumber of exponent bits. bfloat16 has a larger dynamic range with lower precision. e.g. this would be infinity in fp16 https://float.exposed/b0x5f80 https://float.exposed/b0x5f80