3 ms·
That assumes scaling laws still hold up. A bigger model might end up only incrementally more intelligent.
by pennomi 4mo ago
That assumes scaling laws still hold up. A bigger model might end up only incrementally more intelligent.
- ACCount37 4mo agoThey do. Mythos kicked ass while it lasted. And what we know of the scaling law curves promises us even more gains in the future. "The future" being "whenever training and inference at increased scale becomes economical". Which is probably bounded by new generations of hardware, but might also be pushed forward by algorithmic advances.