28 ms·
How well does bf16 work in comparison?
by sroussey 2y ago
How well does bf16 work in comparison?
- KeplerBoy 2y agoEven worse, I'd say since it has fewer bits for the fraction. At least in the example i was mentioning, where you run into precision limits, not into range limits. I believe bf16 was primarily designed as a storage format, since it just needs 16 zero bits added to be a valid fp32.