4 ms·
The point is not to demonstrate a correct response, it is to demonstrate how asking the model to implement something in code can bypass guardrails it has around
by Vegenoid 2y ago
The point is not to demonstrate a correct response, it is to demonstrate how asking the model to implement something in code can bypass guardrails it has around certain topics in more conversational prompting.
- chii 2y agoThe problem is when the censorship is not known in advance. How would you know the answer you got wasn't censored? Or are you going to make a verification prompt every time, phrased as a coding question, to check if the previous answer differed in ways that would imply censorship?