3 ms·
30 years ago read an article in a dead tree magazine by a firmware engineer. He mentioned clipping and flagging over and underflows. His example was sqrt(small
by Gibbon1 8y ago
30 years ago read an article in a dead tree magazine by a firmware engineer. He mentioned clipping and flagging over and underflows. His example was sqrt(small negative number) better to return zero and set a flag than to blow up. Because small negative number is most likely 'nominal zero'