4 ms·
Yeah at some point gpt4 loses track and just consistently is wrong. Lately I can't feed it too much info, the longer the context the more issues. With your su
by jiggywiggy 3y ago
Yeah at some point gpt4 loses track and just consistently is wrong.
Lately I can't feed it too much info, the longer the context the more issues.
With your suggestion, it doesn't know which part of the iteration is correct at the moment. For us iteration is logically but for chatgpt I think it's just more variables that make the chance of being wrong larger. So you need to build that in somehow that it can iteratively filter and prompt
- shmoogy 3y agoIsn't the issue that things fall out of context and then it starts hallucinating a lot more ? Sometimes it helps to just start a new prompt
- jiggywiggy 3y agoI don't know what the issue is. Been happening more lately. Before would ask a lot and would manage, now often 4-5 prompts in seems to just answer without previous context
- jstarfish 3y agoThat's been my experience. At some point it can't "un-learn" its mistakes because it keeps including the "wrong" bits in scope. I have some success saying "no, undo that," waiting for it to return the corrected version, and only then continuing. Oobabooga's UI is better at this, since you can remove erroneous outputs from the context and edit your previous input to steer it in the right direction. Given that OpenAI mines conversations for training data it seems to align with their interests to make you give up and start a new prompt. More abandoned prompts = more training data.