4 ms·

I want to know what the heck they did with $1.5b

• laughingcurve 6y ago
  They spent it on the compute costs for training GPT models. Training a deep learning neural network on massive amounts of data ain't cheap!
  • esyir 6y ago
    Don't forget the data cleaning, gathering and preparation too. That's pretty insanely expensive at that scale.
    • zcw100 6y ago
      GPT-3 is estimated to have cost $4.6 million and yes, gathering and cleaning data can be expensive it's still no where close to $1.5 billion. I'm well aware of some of the kinds of projects that are done with that kind of money. This doesn't seem in their league.