3 ms·
I could explain this. Internally all those coordinates are stored as double (not long double). The precision of a double is max 15-17 digits. Usually it's very
by rurban 7y ago
I could explain this. Internally all those coordinates are stored as double (not long double). The precision of a double is max 15-17 digits. Usually it's very inprecise though. But not too imprecise, because tiny errors could lead to very costly mistakes. my biggest did cost ~40.000, wrong after the third digit. 30cm. You might remember the financial stories on microdiffs with improper arith. That why one of the most important lessons I told my students was precision and it's limits. Esp. when zooming in.
CAD/GIS system round to the default vsprint %f precision which is 6. They could use a zoom dependent number but nobody would do that, they would laugh at you. It's not a delusion, it's industry practise. If you have better precision, you stick to it.