4 ms·
Right, I did realize after posting that close to numbers of the form 1{hidden bit} + (1-2^-52){mantissa with all ones} the relative accuracy — corresponding t
by fiforpg 1y ago
Right, I did realize after posting that close to numbers of the form
1{hidden bit} + (1-2^-52){mantissa with all ones}
the relative accuracy — corresponding to the absolute accuracy of a single bit in mantissa — is about 2^-53. The hidden bit is easy to forget about...