14 ms·
Would this count as an AI Injection attack, and if so, would it be the first? Or does the previous jailbreaks count as the original?
by SkyBelow 4y ago
Would this count as an AI Injection attack, and if so, would it be the first? Or does the previous jailbreaks count as the original?
- not-chatgpt 4y agoIt's a poison attack that randomizes the output, but it does not allow the attack to manipulate the outputs.
- sebzim4500 4y agoI don't think this is any different from prior prompt injection attacks. I am confused about it though, based on the API it looked like <|end_of_text|> was fed into the model as its own special token, and not simply as the ascii sequence used to encode it. Sounds like that isn't happening though, if the GP is correct.