4 ms·
> If an operation exceeds this limit, an insufficient significant bits signal "sNaN(isb)" would be raised. What about for binary repeating decimals like 0.3? W
by jovial_cavalier 9y ago
> If an operation exceeds this limit, an insufficient significant bits signal "sNaN(isb)" would be raised.
What about for binary repeating decimals like 0.3? Wouldn't it always raise that signal?
- oh_sigh 9y agoPresumably if you specify that you want more units of precision than are available, then yes. But if you say you only want 1 significant digit, then it can store it.
- deleted 9y ago[deleted]