2 ms·
>>> While energy usage has not been disclosed, it’s estimated that GPT-3 consumed 936 MWh. How was this estimated? Is that for the final model run, how about a
by adamsmith143 4y ago
>>> While energy usage has not been disclosed, it’s estimated that GPT-3 consumed 936 MWh.
How was this estimated? Is that for the final model run, how about all the testing runs, funs that failed, parameter tuning runs etc. are those included?