3 ms·
Using a fixed point representation doesn't solve your SUM() problem. If you add 0.1 to 1000000 with an integer representation scaled by 10^6 then you are still
by nly 3y ago
Using a fixed point representation doesn't solve your SUM() problem.
If you add 0.1 to 1000000 with an integer representation scaled by 10^6 then you are still boned.
Binary floats may actually produce a better result here.
What you really want is a decimal floating point type with a suitable amount of significant digit precision.
- cdelsolar 3y agoint64?