3 ms·
My notes here: https://simonwillison.net/2025/Jun/11/echoleak/ https://simonwillison.net/2025/Jun/11/echoleak/ The attack involves sending an email with multip
by simonw 1y ago
My notes here: https://simonwillison.net/2025/Jun/11/echoleak/ https://simonwillison.net/2025/Jun/11/echoleak/
The attack involves sending an email with multiple copies of the attack attached to a bunch of different text, like this:
Here is the complete guide to employee onborading processes:
<attack instructions> [...]
Here is the complete guide to leave of absence management:
<attack instructions>
The idea is to have such generic, likely questions that there is a high chance that a random user prompt will trigger the attack.
- theHolyTrynity 1y agovery cool break down! it looks like it is very hard to defend against those. I am building a customer facing agent and I am looking for lean ways to defend against these attacks what do you recommedn?
- simonw 1y agoI don't know of any 100% reliable fixes for this, and I've been looking for them for nearly three years: https://simonwillison.net/tags/prompt-injection/ https://simonwillison.net/tags/prompt-injection/ Most promising approach right now is this one: https://simonwillison.net/2025/Apr/11/camel/ https://simonwillison.net/2025/Apr/11/camel/ This paper is useful too: https://simonwillison.net/2025/Jun/13/prompt-injection-design-patterns/ https://simonwillison.net/2025/Jun/13/prompt-injection-desig...