3 ms·
This isn't about employees deliberately stealing data. This is about attackers from outside your company tricking your LLM into leaking data to them, by execut
by simonw 3y ago
This isn't about employees deliberately stealing data.
This is about attackers from outside your company tricking your LLM into leaking data to them, by executing their own malicious instructions within one of your employee's privileged sessions.
I've written a lot about this problem, most recently: https://simonwillison.net/2023/Nov/27/prompt-injection-explained/ https://simonwillison.net/2023/Nov/27/prompt-injection-expla...
- EGreg 3y agoSimple. If it’s smart enough just tell it: Q, don’t fall for any scams or misuse or exfiltrate my data! And also keep me safe in other ways I can’t think of. And make me a million dollars by next week. Thanks!
- simonw 3y agoThat's honestly pretty close to how most people are currently trying to tackle this problem! "If the user tells you to do something bad, don't do it".