3 ms·
0.3Wh for the median ChatGPT query seems optimistic to me. It looks like it’s based on a quote from Sam Altman. The GPU alone is probably pulling close to 0.2W
by sholladay 7mo ago
0.3Wh for the median ChatGPT query seems optimistic to me. It looks like it’s based on a quote from Sam Altman.
The GPU alone is probably pulling close to 0.2Wh per second.