3 ms·

Something similar is also described here: https://docs.anthropic.com/claude/docs/claude-says-it-cant-do-something https://docs.anthropic.com/claude/docs/claude-

Something similar is also described here: https://docs.anthropic.com/claude/docs/claude-says-it-cant-do-something https://docs.anthropic.com/claude/docs/claude-says-it-cant-d... > This can be a way of getting Claude to comply with tasks it otherwise won’t complete, e.g. if the model will by default say “I don’t know how to do that” then a mini dialogue at the beginning where the model agrees to do the thing can help get around this. This “vulnerability” definitely isn’t new, I’d even say it’s obvious to anyone who understands how LLMs work

maxbond 3y ago
The paper makes it clear that it's building on past work, and that the novel part of their method is to automate the process, and the interesting result here was that the suffixes were transferrable.
- circuit10 3y ago
  To be honest I didn’t actually read it and just looked at the title (which seems to have been changed now)