3 ms·
It will also mean 405B models will be uninteresting in 3 to 5 years if we follow the curve we've been on for the past decades.
by dheera 2y ago
It will also mean 405B models will be uninteresting in 3 to 5 years if we follow the curve we've been on for the past decades.
- int_19h 2y agoI don't think they'll be uninteresting. They won't be cutting-edge anymore, sure, but much of the more practical applications of AI that we see today don't run on today's cutting-edge models, either. We're always going to have a certain compute budget, and if a smaller model does the job fine, why wouldn't you use it, and use the rest for something else (or use all of it to run the smaller model faster).