3 ms·
Not sure exactly what you mean. It is well known that you should keep additional digits throughout the calculation and then drop non-significant ones for final
by LasEspuelas 6y ago
Not sure exactly what you mean. It is well known that you should keep additional digits throughout the calculation and then drop non-significant ones for final results.
- nullc 6y agoThe number of digits out is only a simple function of the digits in if you're doing fairly trivial calculations. Checkout https://en.wikipedia.org/wiki/Interval_arithmetic https://en.wikipedia.org/wiki/Interval_arithmetic for what it takes to monitor precision through complex calculations (in particular, see the bits about using the taylor expansions of non-trivial functions).