4 ms·
Odd how many of those instructions are almost always ignored (eg. "don't apologize," "don't explain code without being asked"). What is even the point of these
by digging 2y ago
Odd how many of those instructions are almost always ignored (eg. "don't apologize," "don't explain code without being asked"). What is even the point of these system prompts if they're so weak?
- sltkr 2y agoIt's common for neural networks to struggle with negative prompting. Typically it works better to phrase expectations positively, e.g. “be brief” might work better than ”do not write long replies”.
- digging 2y agoBut surely Anthropic knows better than almost anyone on the planet what does and doesn't work well to shape Claude's responses. I'm curious why they're choosing to write these prompts at all.
- esperent 2y agoMaybe it would be even worse without it? I've found that negative prompting is often ignored, but far from always ignored so it's still useful.
- deleted 2y ago[deleted]
- usaar333 2y agoIt lowers the probability. It's well known LLMs have imperfect reliability at following instructions -- part of the reason "agent" projects so far have not succeeded.
- handsclean 2y agoI’ve previously noticed that Claude is far less apologetic and more assertive when refusing requests compared to other AIs. I think the answer is as simple as being ok with just making it more that way, not completely that way. The section on pretending not to recognize faces implies they’d take a much more extensive approach if really aiming to make something never happen.
- Nihilartikel 2y agoSame with my kindergartener! Like, what's their use if I have to phrase everything as an imperative command?
- lemming 2y agoMuch like the LLMs, in a few years their capabilities will be much improved and you won't have to.