3 ms·
Still crazy how easy it is to "jailbreak" even SOTA LLMs with a simple assistantResponse replacement in chat thread.
by 0xkvyb 5mo ago
Still crazy how easy it is to "jailbreak" even SOTA LLMs with a simple assistantResponse replacement in chat thread.
- dotancohen 5mo agoTell us more.
- _3u10 5mo agoI think what he is saying is they are stateless so you can edit its previous repsonses and it just goes with it.
- vorticalbox 5mo agoIf you build a small ui that lets you edit the models response too it’s pretty funny to do. It sees that it “said” it and gets very confused.
- hilariously 5mo agoI have seen it where you can just report it said it and it will be confused.