4 ms·
Or your numbers are wrong because you didn't wrap in parentheses. Example, put these two formulas in excel: =(4/3 - 1)*3 - 1 =((4/3 - 1)*3 - 1)
by OGWhales 4y ago
Or your numbers are wrong because you didn't wrap in parentheses.
Example, put these two formulas in excel:
=(4/3 - 1)*3 - 1
=((4/3 - 1)*3 - 1)
- dns_snek 4y agoThe online version, at least, seems to be wrong when you do wrap it in parentheses: =(4/3 - 1)*3 - 1 = 0 =((4/3 - 1)*3 - 1) = -2.22045E-16
- OGWhales 4y agoCheck out page 3-5 of this paper called How Futile are Mindless Assessments of Roundoff in Floating-Point Computation? [0]. It explains what is happening here better than I can and is where I got this example from. [0]: https://people.eecs.berkeley.edu/~wkahan/Mindless.pdf https://people.eecs.berkeley.edu/~wkahan/Mindless.pdf