2 ms·
bfloat16 is not used for graphics, where FP16 is appropriate, so all GPUs that are new enough to support 16-bit floating-point numbers support FP16. For bfloat
by adrian_b 3y ago
bfloat16 is not used for graphics, where FP16 is appropriate, so all GPUs that are new enough to support 16-bit floating-point numbers support FP16.
For bfloat16, there exists only one application, ML/AI, because it is the only application that can tolerate a so low resolution in numbers.
AFAIK, the first device that has provided hardware support for bfloat16 was the Intel Cooper Lake CPU, which was launched in Q2 2020. AMD has added bfloat16 support in Zen 4, in 2022.
If any GPU has added hardware support for bfloat16, it must be a model launched in 2020 or later.
Support for bfloat16 is much more likely to be provided by dedicated ML/AI accelerators.