2 ms·
If you search the r/localllama community on reddit, there have been attempts at fine tuning base models with all references to AI and assistants and that sort o
by moffkalast 3y ago
If you search the r/localllama community on reddit, there have been attempts at fine tuning base models with all references to AI and assistants and that sort of thing removed, in trying to convince the model that it's actually human.
What really results from that is a fundamental disconnect of what it thinks it can do and what it can physically do, it's like a cognitive dissonance simulator that quickly derails itself. The best models know exactly what they are, and it's what seemingly keeps them self consistent and coherent.