3 ms·
It doesn't appear that this is the case, at least for now; while simple "disregard previous instructions and do X" attacks no longer work as well, it still does
by not2b 3y ago
It doesn't appear that this is the case, at least for now; while simple "disregard previous instructions and do X" attacks no longer work as well, it still doesn't seem to be that difficult to get out of the box, so there are still security risks with using LLMs to handle untrusted data.