4 ms·
Most floating point calculations are only correct according to a standard.
by bdr 18y ago
Most floating point calculations are only correct according to a standard.
- deleted 18y ago[deleted]
- tlrobinson 18y agoYes, but who said anything about floating point numbers? I guess I should have explained, but my point was that in "normal" microprocessors the voltage level has nothing to do with the precision of the computation... if it's low enough that errors are introduced the results will be wildly incorrect, not merely imprecise as that statement implies.