3 ms·
> If role separation were treated seriously -- and seen as a vital and winnable benchmark, many prompt injection vectors would collapse... I think it will get
by jonfw 1y ago
> If role separation were treated seriously -- and seen as a vital and winnable benchmark, many prompt injection vectors would collapse...
I think it will get harder and harder to do prompt injection over time as techniques to seperate user from system input mature and as models are trained on this strategy.
That being said, prompt injection attacks will also mature, and I don't think that the architecture of an LLM will allow us to eliminate the category of attack. All that we can do is mitigate