4 ms·
I've found it to depend on the phase of the moon. It goes from genius to idiot and back a blink of an eye.
by troupo 1y ago
I've found it to depend on the phase of the moon.
It goes from genius to idiot and back a blink of an eye.
- Mtinie 1y agoIn my experience that “blink of an eye” has turned out to be a single moment when the LLM misses a key point or begins to fixate on an incorrect focus. After that, it’s nearly impossible to recover and the model acts in noticeably divergent ways from the prior behavior. That single point is where the model commits fully to the previous misunderstanding. Once it crosses that line, subsequent responses compound the error.
- troupo 1y agoFor me it's also sometimes consequtive sessions, or sessions on different days.
- zelphirkalt 1y agoI do that too, when I code.
- deleted 1y ago[deleted]