3 ms·
Have you seen my writing on prompt injection (a term that I coined)? That's pretty negative! https://simonwillison.net/series/prompt-injection/ https://simonwi
by simonw 10mo ago
Have you seen my writing on prompt injection (a term that I coined)?
That's pretty negative! https://simonwillison.net/series/prompt-injection/ https://simonwillison.net/series/prompt-injection/
There's a whole section in the linked piece about how Cowork doesn't do enough here, including:
> I do not think it is fair to tell regular non-programmer users to watch out for “suspicious actions that may indicate prompt injection”
- what 10mo agoI don’t think you coined “prompt injection”…
- simonw 10mo agohttps://simonwillison.net/2022/Sep/12/prompt-injection/ https://simonwillison.net/2022/Sep/12/prompt-injection/ > This isn’t just an interesting academic trick: it’s a form of security exploit. I propose that the obvious name for this should be prompt injection. I've written about it 142 times since then: https://simonwillison.net/tags/prompt-injection/ https://simonwillison.net/tags/prompt-injection/ I'm credited for coining the term on Wikipedia and in several academic papers. I don't claim to have discovered the vulnerability - I credited that to Riley Goodside, but we later learned it was independently discovered and first reported to OpenAI by Jonathan Cefalu of Preamble, see https://www.preamble.com/prompt-injection-a-critical-vulnerability-in-the-gpt-3-transformer-and-how-we-can-begin-to-solve-it https://www.preamble.com/prompt-injection-a-critical-vulnera...