2 ms·
Low precision ML is less than 8 bits. 32-bit floating point is the highest precision used.
by skummetmaelk 9y ago
Low precision ML is less than 8 bits. 32-bit floating point is the highest precision used.
- trsohmers 9y agoThe Titan and Tesla NVIDIA cards are still built with 64 bit/double precision in mind with "only" a 50% performance reduction compared to FP32 in most of those devices. It is the GeForce gaming cards and the ones being targeted now for ML that are gimping FP64, where it is 1/4th or even 1/16th the speed of FP32. The vast majority of "real" HPC still requires FP64 (only large industry categorized under HPC that I know is perfectly fine with FP32 is geospatial oil & gas stuff)... a valid LINPACK has a hard FP64 requirement.