3 ms·

You can bypass the system prompt by using the API? I thought part of the "safety" of LLMs was implemented with the system prompt. Does that mean it's easier to

You can bypass the system prompt by using the API? I thought part of the "safety" of LLMs was implemented with the system prompt. Does that mean it's easier to get unsafe answers by using the API instead of the GUI?

pegasus 1y ago
Yes, it is.
minimaxir 1y ago
Safety is both the system prompt and the RLHF posttraining to refuse to answer adversarial inputs.