4 ms·
I'm not sure, I see an argument that they're mostly overblown and a lot would have to be true for one of these proof-of-concepts to translate into a real harm i
by andy99 1y ago
I'm not sure, I see an argument that they're mostly overblown and a lot would have to be true for one of these proof-of-concepts to translate into a real harm in the wild.
I definitely think they need to be taken seriously, just not convinced of the scale of the harm that will be wrought.
- simonw 1y agoAn attack where somebody emails the VP of marketing of a company and gets automatically leaked their latest sales figures feels pretty impactful to me. Or emails the CEO and gets automatically forwarded all of their password reset messages.
- simonw 1y agoOut of interest, when you said "mostly overblown" were you thinking of prompt injection as "people inject bad prompts into an LLM" (I'd call that "jailbreaking") or were you thinking of the thing where an attacker sneaks bad instructions into the model against the wishes of the model's actual user, eg by hiding instructions on a web page that gets summarized or sending them to the victim in an email?
- deleted 1y ago[deleted]