Except, why would it start over? A language model doesn’t actually have an opinion independent of whatever text it’s outputting. The prompt is the opinion. Star

Except, why would it start over? A language model doesn’t actually have an opinion independent of whatever text it’s outputting. The prompt is the opinion. Start over with a new chat session and it will emit different words, causing it to have a different opinion. If you could edit the chat history directly, you would change its opinion and it would continue from there. It’s true that if the training data contained a lot of text where the authors changed their minds a lot then the language model would learn to “change its mind” a lot in a similar way, but neither the old opinion nor the new opinion is its “real” opinion. It’s just the opinion it’s pretending to have now. It would be tricky to come up with training data where, when an author changes its mind, the new text is always better than what they had before. Sometimes edits make things worse. It might be fun to try, though.