4 ms·
My understanding is ChatGPT is using the conversation, including it's own responses, to guide the text generation - the problem being that when it goes off the
by taberiand 4y ago
My understanding is ChatGPT is using the conversation, including it's own responses, to guide the text generation - the problem being that when it goes off the rails (compared to user expectation) redirecting it can be impossible, because it gets too wrapped up in the current context.
People think they can reason it back onto the right track, but reasoning doesn't factor into the process and just gives it more of the same context.
Perhaps the option to reset the conversation should be more prominent?
- qup 4y agoExactly, it's in a loop and it's self-reinforcing it's own shitty attitude. The user accidentally goaded it into the smarmy attitude and it amplified it via self-prompting. I think it could be reasoned back on track, or you can just talk long enough it forgets, but it's way easier to start a new chat.
- roflyear 4y agoCorrect. It's good for some stuff and amazing at language but getting stuck in these loops makes it very limited.