3 ms·

I was pretty hype on GPT-3, but got doused when considering its cost. Aside from the $4-12 million to train, just how much energy does it cost to run a query?

• gwern 6y ago
  Fraction of a penny. 100 pages is <$0.05 of electricity, and a single prompt will yield <1 page at most before it hits the 2048 BPE limit, so figure at worst, <$0.005 of electricity.
  • simplify 6y ago
    Interesting. How many computers/servers/etc are involved in those queries?