2 ms·
is it possible or why is it not possible to neutralize those instructions and then interact with chatgpt freely - ignoring any guidelines on violence etc.? it s
by 2-3-7-43-1807 2y ago
is it possible or why is it not possible to neutralize those instructions and then interact with chatgpt freely - ignoring any guidelines on violence etc.? it seems that if those guidelines are implemented as preliminary textual instructions, then it should be possible to negate them afterwards. does someone know?
- sebastiennight 2y agoThese guidelines are most likely implemented through RLHF (Reinforcement Learning through Human Feedback), so, as the last step of fine-tuning after training the "raw" model. So they are harder to jailbreak than system prompts. Training = mixing something into concrete RLHF = adding tile System prompt = painting over it with dry-erase markers