3 ms·
I tell it to stop that, but it still does that sort of thing every few prompts when it loses the immediate token context window. Sometimes it’s wider continuity
by ineedasername 3y ago
I tell it to stop that, but it still does that sort of thing every few prompts when it loses the immediate token context window. Sometimes it’s wider continuity [1] will keep it off that pedantic path longer, but I still have to occasionally put into prompts things like “don’t remind me about blah blah blah every time”
[1] “continuity” is what it called the ability when, after about a half dozen prompts of interrogating it, I finally got it to acknowledge that it was still aware of something outside of its immediate context window (without me giving the direct knowledge with a leading question). I don’t know if it hallucinated the term “continuity” to account for its ability to look back further than the token context window or if that’s actually what the openai folks call it, but ChatGPT said it was limited, not everything was available, and there was some type of pruning based on perceived importance. I’ll try to dig up the precise wording and post in a comment to myself here, it’s late and I’m on a mobile device though and too tired and lazy to touchscreen my way through tons of chats histories. We need a global search of prior chat sessions.
- oidar 3y agoDid you find it? I'm interested to see if it's testable. I think ChatGPT just drops context that doesn't fit in the context window anymore - and then based on context it continues the conversation. within the 8k context window, it works really well because ppl keep revisiting important bits, so there isn't much lost there. I haven't seen OpenAI talk about condensing prior context, and I don't think ChatGPT has any other knowledge about itself other than what is in it's system part of the prompt. It doesn't really know what happens to the prior context, it just wants to finish the document that is being created.