2 ms·
You can confuse the LLM to reveal its system prompt even if you put it behind a service API IMHO, as long as a user has access to the chat and can freely intera
by lunarcave 2y ago
You can confuse the LLM to reveal its system prompt even if you put it behind a service API IMHO, as long as a user has access to the chat and can freely interact with the LLM.
- simpaticoder 2y agoI've heard this is the general case, but is it proven that a prompt can always be recovered? I'm thinking particularly of cases where the LLM supports very large prompts, on the order of millions of tokens. It would be interesting to see if there is a way to bake in the prompt with the weights which may also be a valuable performance improvement, in addition to obscuring the prompt.