2 ms·
Interesting concept, but is it going to age well with context sizes of models are changing all the time (growing, mostly)?
by jannniii 9mo ago
Interesting concept, but is it going to age well with context sizes of models are changing all the time (growing, mostly)?
- Retr0id 9mo agomax context sizes are probably going to go up, but smaller contexts will always be cheaper/more-efficient than larger ones