3 ms·
Thermodynamics will dictate the performance in some sense of bit-operations per Joule sense. The more important performance metric is not the number of bit-ope
by eru 3y ago
Thermodynamics will dictate the performance in some sense of bit-operations per Joule sense.
The more important performance metric is not the number of bit-operations, but the quality of the neural network output.
The hypothesis is that fewer bits in your numbers give you the same or nearly the same output quality, but at drastically fewer bit operations performed, and thus less Joule spent.