3 ms·
Interesting point about energy cost. If GPT inference keeps scaling, latency + watt efficiency might become central to AGI deployment.
by dydghks2033 1y ago
Interesting point about energy cost. If GPT inference keeps scaling, latency + watt efficiency might become central to AGI deployment.