3 ms·
I covered that. There is no "absolutely accurate" in a finite number of bits, no matter what data type you use. In N bits, you can't store more than 2^N distinc
by mark-t 18y ago
I covered that. There is no "absolutely accurate" in a finite number of bits, no matter what data type you use. In N bits, you can't store more than 2^N distinct numbers, and there happen to be a lot more than 2^N distinct numbers, even between 0 and 1. You have to choose your margin for error and be prepared to live with it (or use a variable width format).