3 ms·
Almost. That's why I suggested the name "prompt injection" - because both attacks involve concatenating together trusted and untrusted text. The problem is tha
by simonw 3y ago
Almost. That's why I suggested the name "prompt injection" - because both attacks involve concatenating together trusted and untrusted text.
The problem is that SQL injection has an easy fix: you can use parameterized queries, or correctly escape the untrusted content.
When I coined "prompt injection" I assumed the fix would look the same. 14 months later it's abundantly clear that implementing an equivalent of those fixes for LLMs is difficult to the point of maybe being impossible, at least against current transformer-based architectures.
This means the name "prompt injection" may de-emphasize the scale of the threat!
- ethanbond 3y agoThat makes a ton of sense. Well, keen to hear what you (or The People) come up with as a more suitable alternative.