3 ms·
I'm guessing that "about the same" will be hard to measure, and that at some point, thermodynamics will dictate the maximum performance per power output (assumi
by mensetmanusman 3y ago
I'm guessing that "about the same" will be hard to measure, and that at some point, thermodynamics will dictate the maximum performance per power output (assuming fixed transistor architecture).
- eru 3y agoThermodynamics will dictate the performance in some sense of bit-operations per Joule sense. The more important performance metric is not the number of bit-operations, but the quality of the neural network output. The hypothesis is that fewer bits in your numbers give you the same or nearly the same output quality, but at drastically fewer bit operations performed, and thus less Joule spent.