3 ms·
> Google Sheets uses floats for everything (...) and then requested an Excel install But Excel also uses floats (as in, Single-precision floating-point format,
by ElectricalUnion 4y ago
> Google Sheets uses floats for everything (...) and then requested an Excel install
But Excel also uses floats (as in, Single-precision floating-point format, aka float32), because of "compatibility with Lotus 1-2-3".
https://softwarerecs.stackexchange.com/questions/53292/any-spreadsheet-provide-more-then-double-precision https://softwarerecs.stackexchange.com/questions/53292/any-s...
https://learn.microsoft.com/en-us/office/troubleshoot/excel/floating-point-arithmetic-inaccurate-result https://learn.microsoft.com/en-us/office/troubleshoot/excel/...
- mananaysiempre 4y agoExcel uses floats in its own ways that even experts on floating-point arithmetic find inscrutable[1]. [1] https://people.eecs.berkeley.edu/~wkahan/Mindless.pdf https://people.eecs.berkeley.edu/~wkahan/Mindless.pdf, §2
- t8sr 4y agoAh, but it used ints (or bignum) to represent my pointer values, instead of silently losing precision. This is an anecdote, maybe there are other gotchas I am blissfully ignorant of. (Also, this was 8 years ago.)