Here is the relevant announcement (I believe they made it available in Pytorch as Bfloat16): https://engineering.fb.com/2018/11/08/ai-research/floating-point-m

Here is the relevant announcement (I believe they made it available in Pytorch as Bfloat16): https://engineering.fb.com/2018/11/08/ai-research/floating-point-math/ https://engineering.fb.com/2018/11/08/ai-research/floating-p...