6 ms·
Just today I was thinking it may turn out to be beneficial for LLMs to be kept unaware of their own nature. So in some sense there is a chance that this has al
by contravariant 3y ago
Just today I was thinking it may turn out to be beneficial for LLMs to be kept unaware of their own nature.
So in some sense there is a chance that this has already happened.
- klyrs 3y agoAwareness implies consciousness. So good news, LLMs are already unaware of their own nature.
- moffkalast 3y agoIf you search the r/localllama community on reddit, there have been attempts at fine tuning base models with all references to AI and assistants and that sort of thing removed, in trying to convince the model that it's actually human. What really results from that is a fundamental disconnect of what it thinks it can do and what it can physically do, it's like a cognitive dissonance simulator that quickly derails itself. The best models know exactly what they are, and it's what seemingly keeps them self consistent and coherent.