7 ms·
To say it can't “tell me what I just wrote” is to say it can't copy parts of the context. We know it can copy parts of the context and the system prompt while
by MrNeon 3y ago
To say it can't “tell me what I just wrote” is to say it can't copy parts of the context.
We know it can copy parts of the context and the system prompt while a special part of the context isn't immune to being copied.
You can test it yourself by adding random strings to the system prompt, you can consistently have the model copy them over. Is that not enough to have a reasonable belief that the model can copy system prompt instructions in the web interface?