3 ms·
I think you're overstating the new danger level. The same applies today, you just have to utilize any other internal attack vector, such as code injection in C
by 411111111111111 3y ago
I think you're overstating the new danger level.
The same applies today, you just have to utilize any other internal attack vector, such as code injection in CI, on the deployment server, through a personal dependency etc.
- danShumway 3y ago> The same applies today, you just have to utilize any other internal attack vector, such as code injection in CI, on the deployment server, through a personal dependency etc. None of the mitigation techniques for code injection work for LLMs. Very literally, nobody in the industry has come up with a solution for malicious input into LLMs. It's an entirely different class of vulnerability. There isn't any dependency you can import or sanitization you can do or technique for getting rid of this. In fact, I've seen research papers where security researchers are starting to hint that hardening prompts might actually be impossible for the current batch of LLMs.