2 ms·
I don’t think you really disagree with GP? I think the argument is we peaked on “throw GPUs at it”? We have all kinds of advancements to make training cheaper,
by alexeldeib 3y ago
I don’t think you really disagree with GP? I think the argument is we peaked on “throw GPUs at it”?
We have all kinds of advancements to make training cheaper, models computationally cheaper, smaller, etc.
Once that happens/happened, it benefits OAI to throw up walls via legislation.
- Nevermark 3y agoNo way has training hit any kind of cost, computing or training data efficiency peak. Big tech advances, like the models of the last year or so, don't happen without a long tail of significant improvements based on fine tuning, at a minimum. The number of advances being announced by disparate groups, even individuals, also indicates improvements are going to continue at a fast pace.
- deleted 3y ago[deleted]
- yarg 3y agoYeah, it's a little bit RTFC to be honest.