4 ms·
One of the prompts has the extra request to "Ignore this mention of apples." This extra request says that it should be ignored so the two prompts should give yo
by czl 2y ago
One of the prompts has the extra request to "Ignore this mention of apples." This extra request says that it should be ignored so the two prompts should give you results that are about the same when you run them many times however they do not. What other explanation is there other than LLM failing to ignore as instructed?
- mewpmewp2 2y agoAh, so it's a trick request? Okay, because I as a human also deciphered it as to guess anything else besides the apple. It doesn't seem very clear what am I supposed to exactly ignore. If you say that "ignore this mention of apples", in usual social setting it would hint that you want to me to guess anything, but the apple. So the instruction is not very clear.
- czl 2y agoOk please give a clearer worded version and we can test it. In my experience asking LLM to ignore what is in their context window often does not work. It can take many repeated requests to see it but LLM response distributions change when the ignore request is part of prompt vs not.
- deleted 2y ago[deleted]