4 ms·
They spent it on the compute costs for training GPT models. Training a deep learning neural network on massive amounts of data ain't cheap!
by laughingcurve 6y ago
They spent it on the compute costs for training GPT models. Training a deep learning neural network on massive amounts of data ain't cheap!
- esyir 6y agoDon't forget the data cleaning, gathering and preparation too. That's pretty insanely expensive at that scale.
- zcw100 6y agoGPT-3 is estimated to have cost $4.6 million and yes, gathering and cleaning data can be expensive it's still no where close to $1.5 billion. I'm well aware of some of the kinds of projects that are done with that kind of money. This doesn't seem in their league.