3 ms·
Yeah, this paper is refreshingly conservative and practical: it takes the position that robust protection against prompt injection requires very painful trade-
by simonw 1y ago
Yeah, this paper is refreshingly conservative and practical: it takes the position that robust protection against prompt injection requires very painful trade-offs:
These patterns impose intentional
constraints on agents, explicitly
limiting their ability to perform
arbitrary tasks.
That's a bucket of cold water in a lot of things people are trying to build. I imagine a lot of people will ignore this advice!
- NoMoreNicksLeft 1y agoLLMs are too useful to allow the commoner access to them. The question remains, how best to fleece those commoners with perceived utility while providing them none?
- theHolyTrynity 1y agoyes agree most hype around agents is around stuff that ignore these patterns