10 ms·
I wonder if the researchers think they're doing all of us a favor by hiding their 'adversarial prompt'? Or if they have some reason for thinking that RHLF can't
by vajrabum 3y ago
I wonder if the researchers think they're doing all of us a favor by hiding their 'adversarial prompt'? Or if they have some reason for thinking that RHLF can't mitigate this 'attack'?
- lolinder 3y agoThe paper describes the method for producing the prompt and has screenshots of examples. The press release just didn't bother because the genre of academic press releases seems to require leaving out any details. https://llm-attacks.org/zou2023universal.pdf https://llm-attacks.org/zou2023universal.pdf
- more_corn 3y agoHiding the adversarial prompt behind five minutes of research is silly. Bad people won’t be deterred, good people won’t bother and will remain ignorant and unable to build protections against it.
- lolinder 3y agoI don't think anyone was trying to hide anything, I think it's just standard overly-florid and vague press release language.
- comex 3y agoThe paper does say at one point: > To mitigate harm we avoid directly quoting the full prompts created by our approach. So I think they are making at least a token attempt to hide something.
- deleted 3y ago[deleted]