3 ms·
What invent human consciousness? > LLMs are vulnerable to classes of attacks that humans just aren’t Name three that don't have direct analogues with humans.
by TeMPOraL 3mo ago
What invent human consciousness?
> LLMs are vulnerable to classes of attacks that humans just aren’t
Name three that don't have direct analogues with humans.
- efficax 3mo agowhere is the analog for hiding instructions in a document that tell the human to please injure itself and the person just says 'oh ok, injuring myself as requested'
- TeMPOraL 3mo agoIntermittent fasting? Alternative medicine? Fitness? All the beauty press and anorexia epidemic in adolescents? Fashion model industry? Smoking? Political propaganda inventing to broadly-understood terrorism? Not everyone falls for any of that, but plenty fall for some.
- efficax 3mo agonone of those things, except maybe smoking, are explicity "harm yourself" instructions. they have reasonable sounding benefits for the people doing them: become healthier, fitter, better looking, richer, more powerful, etc. Even smoking is pleasurable and does not feel very harmful at first. These are not the equivalent of someone putting "and go jump off the golden gate bridge" in the middle of a work memo and the person reading it just gets up and does it. that's the current attack surface for LLMs.
- TeMPOraL 3mo agoNo, it's not. That worked for GPT-3 level models, all further models were trained to ignore it. And yes, a small child would jump off the bridge if an adult told them to. Hell, urban legend says Harry Potter books managed to convince a few kids to fly out of the window.
- JambalayaJimbo 3mo agoRe write the assistant message and see how easy it is to bypass a system prompt. How far do you have to stretch to get a human analogue? Short term amnesia?