3 ms·
PIGuard: Prompt Injection Guardrail via Mitigating Overdefense for Free
- mettamage 7mo agoI was playing around with some prompt injection guard rails frameworks. I know they don't mitigate attack classes, but they at least do something. I just got a bit miffed about the high false positive rates I saw in my own testing. This one has a low false positive rate. And I thought that was interesting.
- carterschonwald 7mo agowhile i cant speak regarding arbitrary prompt injections, ive been using a simple approach i add to any llm harness i use, that seems to solve turn or role confusion being remotely viable. i really need to test my toolkit (carterkit) augmented harnesses on some of the more respectavle benchmarks
- ekns 7mo agoThere is a simple way to mitigate prompt injection. Just check metadata only: is this action by the LLM suspicious given trusted metadata, blanking out the data
- ninju 7mo agoYou misspelled 'execute' in the video ;)
- bastawhiz 7mo agoAnd it still did the right thing. Which I think makes the demo slightly more impressive.
- JoshBlythe 7mo ago[dead]