3 ms·
I see you are further along the path to prompting wisdom than op. Positive directions are far superior to negative ones. LLMs don't understand the concept of n
by irthomasthomas 3y ago
I see you are further along the path to prompting wisdom than op.
Positive directions are far superior to negative ones. LLMs don't understand the concept of negation. They work, in a way, by assigning semantic tokens that describe the relationship to other tokens. How could you encode the idea of a negated token?
I have wondered if you could use a similar mechanism to the repetition penalty to penalise chosen tokens that you want to downrank.
- aubanel 3y agoI this idea of LLMs not understanding the concept of negation is false. Both if you ask ChatGPT (GPT4) to explain the concept of negation or ask it to do a task that leverages negation, you get sound results. Example of a conversation leveraging negation: User Hello GPT. Could you write me a sentence longer than 6 words ? ChatGPT: Of course, I'd be happy to help! Here's a sentence for you: "The sun set behind the mountains, casting a stunning array of colors across the evening sky." User: Now, could you write me a sentence not longer than 6 words ? ChatGPT: Absolutely, here it is: "Cats quietly nap in the sun."