3 ms·
GPT-3 costs $4.6 million dollars to train currently[0]. Not only is your comment unnecessarily negative, it's just generally a pretty bad take. [0]: https://la
by lawrenceyan 6y ago
GPT-3 costs $4.6 million dollars to train currently[0]. Not only is your comment unnecessarily negative, it's just generally a pretty bad take.
[0]: https://lambdalabs.com/blog/demystifying-gpt-3/ https://lambdalabs.com/blog/demystifying-gpt-3/
- lowdose 6y agoWhat value is added by training a model yourself? Why don't they provide that model? Isn't the real innovation here to give people a $4.3 million model for free? Instead of letting people burn unnecessary compute power to train a model 2 years behind state of the art.
- lacker 6y agoThe main value is that you can choose your own training data. For example, if you wanted to train a text-generation model on purely C++ code, this would be a good way to do it.
- krageon 6y agoThey don't provide that model because then it can't be rented out to people with less upfront cash for insane profit.