3 ms·
I tried 0.00000000000000000000000000000000000000001 * 2 and it gave me 0. Precision on a calculator is very important, such operations should be exact. Please r
by thrance 2y ago
I tried 0.00000000000000000000000000000000000000001 * 2 and it gave me 0. Precision on a calculator is very important, such operations should be exact. Please refrain from using floating point operations.
- jpc0 2y agoIt may be pedantic from me but what are you calculating that needs that level of precision? Or more specifically, why not just use a different unit base, fixed point arithmetic doesn't come for free.