6 ms·
The Save As clearly outputs single precision floats. Try putting the input values into e.g. https://www.h-schmidt.net/FloatConverter/IEEE754.html https://www.h
by MauranKilom 5y ago
The Save As clearly outputs single precision floats.
Try putting the input values into e.g. https://www.h-schmidt.net/FloatConverter/IEEE754.html https://www.h-schmidt.net/FloatConverter/IEEE754.html - the outputs are just the closest representable float numbers (converted back to a reasonable base-10 representation).
- tedunangst 5y agoBut why are some of them 9.9999? You can represent 10 as 10 in a float.