3 ms·
Choosing the epsilon requires numerical analyis expertise or lucky cargo-cuting: https://randomascii.wordpress.com/2012/02/25/comparing-floating-point-numbers-2
by fulafel 12y ago
Choosing the epsilon requires numerical analyis expertise or lucky cargo-cuting: https://randomascii.wordpress.com/2012/02/25/comparing-floating-point-numbers-2012-edition/ https://randomascii.wordpress.com/2012/02/25/comparing-float...
- dockimbel 12y agoThank you for reminding us about those great articles! We were using a Ulp-based method only, but Qtxie proceeded with some improvements [1] for close to zero values, as suggested in the article. Thanks again. :-) [1] https://github.com/red/red/pull/986 https://github.com/red/red/pull/986