3 ms·
It depends, if you have to retrain existing models using new data(basically updating the cutoff date) it will cost you much less than today ... and I'm pretty s
by vb-8448 1y ago
It depends, if you have to retrain existing models using new data(basically updating the cutoff date) it will cost you much less than today ... and I'm pretty sure today they are aiming for speed and "intelligence improvement" and not training efficiency.
The only scenario where the training cost won't decrease is in case the limit of the scaling law is not yet reached, or they discover new approaches. But from what we have seen this year, it doesn't seem to be the case.
PS: Plus, we are still not speaking about the elephant in the room: ads. Today's revenues are basically from API usage and subscription, but we all know that at some point ads will come in, and the revenues will increase.