4 ms·
I have been using Claude recently and was messing with their projects. The idea is nice: you give it overall instructions, add relevant documents, then you star
by IgorPartola 1y ago
I have been using Claude recently and was messing with their projects. The idea is nice: you give it overall instructions, add relevant documents, then you start chats with that context always present. Or at least that’s what is promised. In reality it immediately forgets the project instructions. I tried a simple one where I run some writing samples through it and ask it to rewrite them with the project description being that I want help getting my writing onto social media platforms. It latched onto the marketing immediately. But one specific instruction I gave it was to never use dashes, preferring commas and semicolons when appropriate. It did that for the first two samples I had it rewrite but after that it forgot.
Another one I tried is when I had it helping me with some Python code. I told it to never leave trailing whitespace and prefer single quotes to doubles. It forgot that after like one or two prompts. And after reminding it, it forgot again.
I don’t know much about the internals but it seems to me that it could be useful to be able to give certain instructions more priority than others in some way.
- Klathmon 1y agoI've found most models don't do good with negatives like that. This is me personifying them, but it feels like they fixate on the thing you told them not to do, and they just end up doing it more. I've had much better experiences with rephrasing things in the affirmative.
- refactor_master 1y agoRelevant elephant discussion: https://community.openai.com/t/why-cant-chatgpt-draw-a-room-without-an-elephant/1138265 https://community.openai.com/t/why-cant-chatgpt-draw-a-room-...
- yunohn 1y agoThis entire thread is questioning why OpenAI themselves use repetitive negatives for various behaviors like “not outputting JSON”. There is no magic prompting sauce and affirmative prompting is not a panacea.
- xwolfi 1y agobecause it is a stupid auto complete, it doesn't understand negation fully, it statistically judge the weight of your words to find the next one, and the next one and the next one. That's not how YOU work, so it makes no sense, you're like "but when I said NOT, a huge red flag popped in my brain with a red cross on it, why the LLM still does it". Because, it has no concept of anything.
- tomalbrc 1y agoThe downvotes perfectly summarize the way the people just eat up OpenAi’s diarrhea, especially Sam Altmans
- joshvm 1y agoThe closest I've got to avoiding the emoji plague is to instruct the model that responses will be viewed on an older terminal that only supports extended ascii characters, so only use those for accessibility. A lot of these issues must be baked in deep with models like Claude. It's almost impossible to get rid of them with rules/custom prompts alone.