3 ms·
> traditional accuracy target of ~1 ULP I had to google this one… ULP: “Unit in the Last Place” or “Unit of Least Precision: https://en.wikipedia.org/wiki/Uni
by WalterGR 6mo ago
> traditional accuracy target of ~1 ULP
I had to google this one…
ULP: “Unit in the Last Place” or “Unit of Least Precision: https://en.wikipedia.org/wiki/Unit_in_the_last_place https://en.wikipedia.org/wiki/Unit_in_the_last_place
- mananaysiempre 6mo agoFor what it’s worth, this is basically the first word you learn when discussing numerical precision; and I mean word—nobody thinks of it as an abbreviation, to the point that it’s very often written in lower case. So welcome to the club.