3 ms·
That is a misunderstanding of floating point. The relationship between trailing non-zero digits in the decimal representation and trailing non-zero bits in the
by jstewartmobile 7y ago
That is a misunderstanding of floating point.
The relationship between trailing non-zero digits in the decimal representation and trailing non-zero bits in the significand is not one-to-one.
One third in a trinary representation would be 0.1. In decimal, 0.33333333333...
Mostly fruitless overprocessing. Only time I'd consider doing this would be for an epic ASCII dump of coordinates.