2 ms·
There is science that uses more sig figs than tha, and for things like inverting matrices or calculating tails of distributions, you want every digit you can ke
by lanstin 3y ago
There is science that uses more sig figs than tha, and for things like inverting matrices or calculating tails of distributions, you want every digit you can keep. Even just simulating dynamic systems, if you truncate, you alter your orbit. And anytime you are summing a lot of values, you want the rounding error not to go too high. I can easily imagine a million velocity data points if you are sampling say 1K/second for a twenty minute trip.
Come to think of it, it would be a cool setting on game engines “8/16/32/64 bit floats”.