3 ms·
This is in fact a common pattern, I think langchain even offers it as part of its Constitutional Chains (an LLM checks the output of another LLM against a polic
by Ozzie_osman 4y ago
This is in fact a common pattern, I think langchain even offers it as part of its Constitutional Chains (an LLM checks the output of another LLM against a policy and in case of violations, required a revision).
I think this would fall under what the blog post classifies as a 95% chance successful defense. People will still be able to find ways to out-prompt it.