3 ms·
I think you may be confusing jailbreaking and prompt injection. Jailbreaking is more akin to social engineering - it's when you try and convince the model to d
by simonw 3y ago
I think you may be confusing jailbreaking and prompt injection.
Jailbreaking is more akin to social engineering - it's when you try and convince the model to do something it's "not supposed" to do.
Prompt injection is a related but different thing. It's when you take a prompt from a developer - "Translate the following from English to French:" - and then concatenate on a string of untrusted text from a user.
That's why it's called "prompt injection" - it's analogous to SQL injection, which was caused by the same mistake, concatenating together trusted instructions with untrusted input.