3 ms·
This is probably about number precision and loosing digits, when you add something with digits only in the beginning like 0.5 to something small like 0.10000000
by zelphirkalt 6y ago
This is probably about number precision and loosing digits, when you add something with digits only in the beginning like 0.5 to something small like 0.1000000000000000000000000000013124142579275927597245205 or whatever a barely representable floating point number is. Then the result becomes inprecise and rounding to nearest will result in the wrong value.
Such effects and similar should be well known to anyone taking on the responsibility to develop a floating point library.