3 ms·
> if we strip out all training/research costs You can't just strip out those costs. You have to train new models or the information in the model will be out of
by sumeno 1y ago
> if we strip out all training/research costs
You can't just strip out those costs. You have to train new models or the information in the model will be out of date.
- vb-8448 1y agoIt depends, if you have to retrain existing models using new data(basically updating the cutoff date) it will cost you much less than today ... and I'm pretty sure today they are aiming for speed and "intelligence improvement" and not training efficiency. The only scenario where the training cost won't decrease is in case the limit of the scaling law is not yet reached, or they discover new approaches. But from what we have seen this year, it doesn't seem to be the case. PS: Plus, we are still not speaking about the elephant in the room: ads. Today's revenues are basically from API usage and subscription, but we all know that at some point ads will come in, and the revenues will increase.