3 ms·
I think the connection that "computer numbers are base 2" is what's missing. You input them into the computer in base 10, and they are printed in base 10. The
by jrockway 16y ago
I think the connection that "computer numbers are base 2" is what's missing. You input them into the computer in base 10, and they are printed in base 10. The base 10 representation is wrong because information was lost when converting to a fixed-width base 2 number. But that is hidden by the compiler or program, so it confuses programmers and users.
It works in Excel...
- caf 16y agoExcel does "cosmetic" rounding, that ends up producing some surprising results - in the words of this author, it "confers supernatural powers upon some (not all) parentheses": http://www.cs.berkeley.edu/~wkahan/Mindless.pdf http://www.cs.berkeley.edu/~wkahan/Mindless.pdf