2 ms·
I'm assuming you mean equality comparison, rather than comparison in general! but is there a better algebraic structure to use when thinking of floats? like, i
by sterlind 3y ago
I'm assuming you mean equality comparison, rather than comparison in general!
but is there a better algebraic structure to use when thinking of floats? like, in terms of limits, or something that tracks significant digits and uncertainty? how do formal methods handle these?
- Y_Y 3y agoThere's more than one way to skin that cat, but interval arithmetic is a good and simple model. You can take the part of the real line which maps to the single float you are thinking about, and then look at the image of that set under the whatever functions you are thinking about.