3 ms·
> The full data of what's in an LLM's "consciousness" is the conversation context. No it's not, see research on hiddens states using SAE's and other methods. T
by j-bos 6mo ago
> The full data of what's in an LLM's "consciousness" is the conversation context.
No it's not, see research on hiddens states using SAE's and other methods. TBC, I agree with your second point, though I still believe top level OP was reckless and is now doing the businessman's version of throwing the dog under the bus.
- Kim_Bruning 6mo agoWe might actually be in full agreement. You can't get a faithful replay of these internal states. They're gone at end of generation. You can only query and re-derive from the visible context. Hence limited (though not zero) utility, depending on model, harness, and prompt.