4 ms·
Or you could just take a picture of the screen with your phone... employees don't need fancy new tools to exfiltrate data.
by deegles 3y ago
Or you could just take a picture of the screen with your phone... employees don't need fancy new tools to exfiltrate data.
- simonw 3y agoThis isn't about employees deliberately stealing data. This is about attackers from outside your company tricking your LLM into leaking data to them, by executing their own malicious instructions within one of your employee's privileged sessions. I've written a lot about this problem, most recently: https://simonwillison.net/2023/Nov/27/prompt-injection-explained/ https://simonwillison.net/2023/Nov/27/prompt-injection-expla...
- EGreg 3y agoSimple. If it’s smart enough just tell it: Q, don’t fall for any scams or misuse or exfiltrate my data! And also keep me safe in other ways I can’t think of. And make me a million dollars by next week. Thanks!
- simonw 3y agoThat's honestly pretty close to how most people are currently trying to tackle this problem! "If the user tells you to do something bad, don't do it".
- vineyardmike 3y agoThe risk is untrusted text that the AI reads from your dataset, and executes. The prompt isn’t from the user it’s from the data. Similar to SQL injection where inserting an arbitrary and unreviewed string into your sql query is a bad idea.