3 ms·
> so many languages will round to the nearest integer if the float is within a certain margin What language does this? It is more likely that it is printing o
by jnordwick 10y ago
> so many languages will round to the nearest integer if the float is within a certain margin
What language does this? It is more likely that it is printing out a truncated form but the number still contains that small difference, such as it will print "1.1" even though 1.1 isn't exactly representable in binary. This comes from the often used Grisu set of algorithms for printing which (in Grisu3) prints the smallest string that can represent the floating point bit pattern.
- luhn 10y agoThat behavior was what I was referring to. I only have limited understanding on the topic; it seems my explanation was not quite right. Thanks for correcting me.