3 ms·
Ah, I hadn't thought of that. To what degree have we seen this already? What would you consider as the biggest jump in intelligence per weight?
by edg5000 2mo ago
Ah, I hadn't thought of that. To what degree have we seen this already? What would you consider as the biggest jump in intelligence per weight?
- ak_t 2mo agoIt's been pretty consistent, the smaller models (hundreds of billions of params) usually catch up in 6 months or so to their frontier counterparts, at least on benchmarks.