3 ms·
That paper does not say what you claim it does, it is not showing that GPUs are computing at lower resolution, nor that CUDA is failing to adhere to the IEEE 75
by dahart 7y ago
That paper does not say what you claim it does, it is not showing that GPUs are computing at lower resolution, nor that CUDA is failing to adhere to the IEEE 754 standard.
In at least two cases, it says the opposite of what you just claimed:
FMA on the GPU was a way to achieve higher float precision than you could with CPU math, in 2011 when the paper was written. That is changing now with CPU adoption of fma, but that doesn't change the claims of the paper.
The GPU's strict adherence to IEEE 754 is mentioned multiple times.
"The same inputs will give the same results for individual IEEE 754 operations to a given precision on the
CPU and GPU. As we have explained, there are many
reasons why the same sequence of operations may not be
performed on the CPU and GPU. The GPU has fused
multiply-add while the CPU does not. Parallelizing algorithms may rearrange operations, yielding different
numeric results. The CPU may be computing results in
a precision higher than expected. Finally, many common mathematical functions are not required by the
IEEE 754 standard to be correctly rounded so should
not be expected to yield identical results between implementations."