3 ms·
> In a subsequent round, it generally can't meaningfully introspect on its prior internal state It has the K/V cache, no?
by AlexCoventry 6mo ago
> In a subsequent round, it generally can't meaningfully introspect on its prior internal state
It has the K/V cache, no?
- Sinidir 6mo agoThe K/V Cache is just an optimization. But yeah you would expect the attention for the model producing "Ok im doing X" and you asking "Why did you do X?" be similar. So i don't see a reason why introspection would be impossible. In fact trying to adapt a test skill where the agent would write a new test instead of adapting a new one i asked it why and it gave the reasoning it used. We then adapted the skill to specifically reject that reasoning and then it worked and the agent adapted the existing test instead.