Even worse, I'd say since it has fewer bits for the fraction. At least in the example i was mentioning, where you run into precision limits, not into range limi

Even worse, I'd say since it has fewer bits for the fraction. At least in the example i was mentioning, where you run into precision limits, not into range limits. I believe bf16 was primarily designed as a storage format, since it just needs 16 zero bits added to be a valid fp32.