3 ms·
My guess is you'll be running GPT4 equivalent in your closet, but with a 4K context window. Where the big guys will have GPT-who-cares-what-version with a 100K
by mvkel 3y ago
My guess is you'll be running GPT4 equivalent in your closet, but with a 4K context window.
Where the big guys will have GPT-who-cares-what-version with a 100K context window.
Context size is as much of a big deal as newer generations of models imo.
- mptest 3y agoAm I right in my layman's understanding that context windows scaling up requires (mainly) much more compute at run time? Or do longer context models require different/longer training?