4 ms·
Don't you have that by just resuming old convo? The only issue is that it didn't hit the cache so it was expensive if you resume later.
by elAhmo 6mo ago
Don't you have that by just resuming old convo?
The only issue is that it didn't hit the cache so it was expensive if you resume later.
- eknkc 6mo agoNot at the moment apparently. They remove the thinking messages when you continue after 1 hour. That was the whole idea of that change. So the LLM gets all your messages, its responses etc but not the thinking parts, why it generated that responses. You get a lobotomised session.
- elAhmo 6mo agoOK didn't know that. I also resume fairly old sessions with 100-200k of context, and I sometimes keep them active for a while (but with large breaks in between). Still on Opus 4.6 with no adaptive thinking, so didn't really notice anything worse in the past weeks, but who knows.
- tbrockman 6mo agoOr generate tiny filler messages every hour until you come back to it.