3 ms·
Presumably it drops back to 4.8 in those cases so it's not really worse
by sebzim4500 3mo ago
Presumably it drops back to 4.8 in those cases so it's not really worse
- tyre 3mo agoyes. At the bottom of the release post it says that they are releasing two new features, one of which is customizing fallback behavior instead of blocking for restricted models
- bobbylarrybobby 3mo agoIf it switches mid conversation, this is a massive increase in token consumption because it has to re-read your conversation into cache, right?