When using system prompts, you still need to finetune the language model to follow the content of the system prompt. I think that you can't quite replace consti

When using system prompts, you still need to finetune the language model to follow the content of the system prompt. I think that you can't quite replace constitutional AI with a constitution-systemprompt even if you do this. In practice, LMs still need chain of thought to determine whether an output is consistent with the constitution.