3 ms·
We sort of already know that these models scale in such a way that a model with 1000 times the parameters is, indeed, 1000 times more powerful. We haven't found
by Lyapunov_Lover 5y ago
We sort of already know that these models scale in such a way that a model with 1000 times the parameters is, indeed, 1000 times more powerful. We haven't found a ceiling effect yet, so the onus is on the skeptics. These things scale.
- ma2rten 5y agoAccording to the scaling laws it scales on a log scale.