11 ms·
It's nuts how large and different the attack surfaces have gotten with AI
by jjmaxwell4 2y ago
It's nuts how large and different the attack surfaces have gotten with AI
- 0cf8612b2e1e 2y agoHuman text is now untrusted code that is getting piped directly to evaluation. You would not let users run random SQL snippets against the production database, but that is exactly what is happening now. Without ironclad permissions separations, going to be playing whack a mole.
- TeMPOraL 2y agoIn a sense, it's the same attack surface as always - we're just injecting additional party into the equation, one with different (often broader) access scope and overall different perspective on the system. Established security mitigations and practices have assumptions that are broken with that additional party in play.
- swyx 2y agohave they? as other comments mention this is the same attack surface as a regular phishing attack.
- namaria 2y agoIt's plainly not, when a phishing attack is receiving unsolicited links and providing compromising data, while this is getting it by asking the AI for something and getting a one-click attack injected in the answer.