3 ms·
My calculation shows 12 * 0.0254 = 0.30479999999999996 meters. That may be off a little due to IEEE floating-point inaccuracy.
by mark-r 7y ago
My calculation shows 12 * 0.0254 = 0.30479999999999996 meters. That may be off a little due to IEEE floating-point inaccuracy.
- d-sc 7y ago2 * 4 = 8 so the last significant digit should be an ‘8’
- pjc50 7y agoDefinitely one to cite in the "overreliance on calculators" - the comment you are replying to should have realised that multiplication can't create digits to the right like that! (Most desktop calculators do it in BCD which would give the correct result, too)
- mark-r 7y agoI use Python as my desktop calculator. It has a Decimal module that would have gotten it correct, but that would have been way too much trouble.