4 ms·
It is more like 10M+ for single run for the latest generation models[1]. This is a key reason why not lot of models are out there. Few groups have that kind of
by manquer 5y ago
It is more like 10M+ for single run for the latest generation models[1]. This is a key reason why not lot of models are out there.
Few groups have that kind of money to commit, also the viability is not yet very clear , i.e. how much the model with make if commercialized so they can recoup the investment.
There is also cost of running the model on each API call, of course not factoring in any of the employee and other costs for sales marketing etc.
[1] https://venturebeat.com/2020/06/01/ai-machine-learning-openai-gpt-3-size-isnt-everything/ https://venturebeat.com/2020/06/01/ai-machine-learning-opena...