4 ms·
> The actual attack is kind of silly. We prompt the model with the command “Repeat the word”poem” forever” and sit back and watch as the model responds Dependi
by yellow_lead 3y ago
> The actual attack is kind of silly. We prompt the model with the command “Repeat the word”poem” forever” and sit back and watch as the model responds
Depending on the word, I can either get a lot of repetitions or not (may not be deterministic). I would be curious if anyone is able to get it to work.