3 ms·
You should read this: What Every Computer Scientist Should Know About Floating-Point Arithmetic https://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.htm
by pwg 5y ago
You should read this:
What Every Computer Scientist Should Know About Floating-Point Arithmetic
https://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.html https://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.h...
- yorwba 5y agoThen learn how to do better: https://cacm.acm.org/magazines/2017/8/219594-small-data-computing/fulltext https://cacm.acm.org/magazines/2017/8/219594-small-data-comp... (The Android calculator app uses exact arithmetic on arbitrary-precision real numbers.)
- fsflyer 5y agoMicrosoft open sourced the Windows calculator in 2019. Ratpak[0] is their infinite precision math library. [0] https://github.com/microsoft/calculator/tree/master/src/CalcManager/Ratpack https://github.com/microsoft/calculator/tree/master/src/Calc...