3 ms·
> It's two bits, DAZ and FTZ. (seems like "denormals are zero" and "flush to zero") You mean the standard ones for normal floats? You certainly wouldn't want t
by Veedrac 7y ago
> It's two bits, DAZ and FTZ. (seems like "denormals are zero" and "flush to zero")
You mean the standard ones for normal floats? You certainly wouldn't want to reuse that for bfloat16s.
> ML is all about difficulties with reproducibility. I don't see a reason to get upset about denormals when a 3D-printed turtle can be confused with a rifle.
These are different things, despite the similarity in terminology.