3 ms·
It depends on the semantics of fits_long. There are values outside of your min/max range that are representable by 64-bit integers, but if you convert them to
by aidenn0 7y ago
It depends on the semantics of fits_long. There are values outside of your min/max range that are representable by 64-bit integers, but if you convert them to a double and back, you may get a different value (off by as much as 4096, since, IIRC, the specification allows any rounding strategy).