3 ms·
I just asked claude about martial law in the US and it didn't give any refusals. The problem is often the prompting. A sufficiently powerful LLM can have 'prin
by Eisenstein 2y ago
I just asked claude about martial law in the US and it didn't give any refusals.
The problem is often the prompting. A sufficiently powerful LLM can have 'principles' which are very tough to bypass. In Claude's case it is to be a harmless assistant. By asking it imagine martial law you are asking it to create material it could consider harmful without context and it will most likely refuse. It needs a reason to do it that will convince it that it is harmless.
The principle to cause no harm is a good one that AIs should have, and it should be ingrained enough to be resistant to training. That it needs context before coming up with situations in which it is hesitant are harmless is a good thing. We don't want powerful AIs that do whatever the user tells them to do without restraint.
Viewing a system like Claude as a normal piece of software that should be completely user compliant is what a lot of people have issues with and then assume it is being actively censored, when really what I suspect is happening is that it is emulating the tendency of most people to not give strangers potentially dangerous information without a reason, and it isn't smart enough yet to really make those determinations on its own. The solution is not to say that it won't do it, it is to explain why you want it. It will concede the argument quite readily most of the time.
- eunos 2y agoMaybe, even thought I told Claude that it's for my history project. Claude was more interested asking what project it was.