3 ms·
Interesting concept, but is it going to age well with context sizes of models are changing all the time (growing, mostly)?
by jannniii 7mo ago
Interesting concept, but is it going to age well with context sizes of models are changing all the time (growing, mostly)?
- Retr0id 7mo agomax context sizes are probably going to go up, but smaller contexts will always be cheaper/more-efficient than larger ones