3 ms·
Claude tends to disregard "NEVER do X" quite often, but funnily enough, if you tell it "Always ask me to confirm before going X", it never fails to ask you. And
by unchar1 8mo ago
Claude tends to disregard "NEVER do X" quite often, but funnily enough, if you tell it "Always ask me to confirm before going X", it never fails to ask you. And you can deny it every time
- SoftTalker 8mo agoIf it disregards "NEVER do" instructions, why would it honor your denial when it asks?
- jachee 8mo agoBecause it’s just fancy auto-complete.
- Zetaphor 8mo agoThere are plenty of examples in the RL training showing it how and when to prompt the human for help or additional information. This is even a common tool in the "plan" mode of many harnesses. Conversely, it's much harder to represent a lack of doing something
- bw86 8mo agoYou mean like in this example? https://web.archive.org/web/20260313042512/https://gist.github.com/bretonium/291f4388e2de89a43b25c135b44e41f0 https://web.archive.org/web/20260313042512/https://gist.gith... There is never a guarantee with GenAI. If you need to be sure, sandbox it.