4 ms·
Agreed. And that near zero work has a near zero energy cost. In addition, silicon inference (combining hardware and software advances) continues to be optimize
by pama 1y ago
Agreed. And that near zero work has a near zero energy cost. In addition, silicon inference (combining hardware and software advances) continues to be optimized and become more energy efficient at a rapid rate.
There exists an unfounded myth surrounding the extreme energy costs of silicon-based inference, which is far from reality.