3 ms·
If it disregards "NEVER do" instructions, why would it honor your denial when it asks?
by SoftTalker 7mo ago
If it disregards "NEVER do" instructions, why would it honor your denial when it asks?
- jachee 7mo agoBecause it’s just fancy auto-complete.
- Zetaphor 7mo agoThere are plenty of examples in the RL training showing it how and when to prompt the human for help or additional information. This is even a common tool in the "plan" mode of many harnesses. Conversely, it's much harder to represent a lack of doing something
- bw86 7mo agoYou mean like in this example? https://web.archive.org/web/20260313042512/https://gist.github.com/bretonium/291f4388e2de89a43b25c135b44e41f0 https://web.archive.org/web/20260313042512/https://gist.gith... There is never a guarantee with GenAI. If you need to be sure, sandbox it.