4 ms·
IEEE standard prescribes 1 ulp precision for some higher operations (trig ops etc). 0.5 ulp does guarantee identical results, but not 1
by dnautics 6mo ago
IEEE standard prescribes 1 ulp precision for some higher operations (trig ops etc). 0.5 ulp does guarantee identical results, but not 1