3 ms·
> sometimes called prompt canarying or decoy system prompts. Both "prompt canarying" and "decoy system prompts" give 0 hits on google. Those aren't real things
by anywhichway 1y ago
> sometimes called prompt canarying or decoy system prompts.
Both "prompt canarying" and "decoy system prompts" give 0 hits on google. Those aren't real things.
- ethbr1 1y agoMaybe it was trained on some internal documentation. ;)
- superjose 1y agoI did a search and found reltive terms: https://www.reddit.com/r/hacking/comments/1kqi0tm/how_canaries_stop_prompt_injection_attacks/ https://www.reddit.com/r/hacking/comments/1kqi0tm/how_canari... https://medium.com/@tomer2138/how-canaries-stop-prompt-injection-attacks-fdf1a6b00c27 https://medium.com/@tomer2138/how-canaries-stop-prompt-injec...
- yencabulator 1y agoThose talk about a mechanism to detect prompt injection. If that had been true, we should have seen the chatbot refuse, not lie.