4 ms·
Is there a reason not to have another “unbroken” chat instance check the output for violations? It seems like a simple “does the following response violate your
by jasonlfunk 4y ago
Is there a reason not to have another “unbroken” chat instance check the output for violations? It seems like a simple “does the following response violate your rules?” would stop most of these “jailbreaks”.
- taneq 4y agoIs there a reliable way to 'escape' input? How would you stop the second instance from also being jailbroken by the prompt that tripped up the first instance?
- astrange 4y agoBuild a different model architecture where the system prompt is a different head than the user prompt and is always equally weighted. Maybe.