3 ms·
The result of 7233629131 / 137438953472 is 18.999999997649866. This is wrong, the divisor and dividend are the wrong way around. ..and in case anyone else is
by caf 10y ago
The result of 7233629131 / 137438953472 is 18.999999997649866.
This is wrong, the divisor and dividend are the wrong way around.
..and in case anyone else is wondering how those numbers relate to the constant in the code, it's
2^37 / (2938661835 + 2^32)
- jwilk 10y agoIt's been fixed.