3 ms·
Unfortunately, it is out of the question. OpenAI trains on hundreds of thousands of dollars of GPUs and even then the trainings take two weeks. Also, as far as
by SleekEagle 5y ago
Unfortunately, it is out of the question. OpenAI trains on hundreds of thousands of dollars of GPUs and even then the trainings take two weeks. Also, as far as I know their training data (400 M image/caption pairs) is not available to the public!
- GaggiX 5y agofortunately there are even larger public datasets like LAION 5b
- manquer 5y agoIt is more like 10M+ for single run for the latest generation models[1]. This is a key reason why not lot of models are out there. Few groups have that kind of money to commit, also the viability is not yet very clear , i.e. how much the model with make if commercialized so they can recoup the investment. There is also cost of running the model on each API call, of course not factoring in any of the employee and other costs for sales marketing etc. [1] https://venturebeat.com/2020/06/01/ai-machine-learning-openai-gpt-3-size-isnt-everything/ https://venturebeat.com/2020/06/01/ai-machine-learning-opena...