4 ms·
Floats all the way. Its floats compounding errors so they estimate the error along the way and then adjust the results. Its floats all the way down!
by PaulKeeble 11mo ago
Floats all the way. Its floats compounding errors so they estimate the error along the way and then adjust the results. Its floats all the way down!
- dahart 11mo agoOh now that is somewhat surprising! Is this 64 bit or 128 bit floats? 32 bit floats aren’t accurate enough to represent $1B to the penny. Do error values get stored as deltas and passed around with the float values? Would love to hear more about this, do you know of any good summaries of the engineering workflow online?