3 ms·
Building a filter for prompt injection attacks is way harder than you might expect. Nobody has produced a convincing implementation of one of those yet (plenty
by simonw 3y ago
Building a filter for prompt injection attacks is way harder than you might expect. Nobody has produced a convincing implementation of one of those yet (plenty of people have tried).
Read https://llm-attacks.org/ https://llm-attacks.org/ to understand why it's so difficult - that's a paper which generates an unlimited series of weird sequences of tokens which are found to subvert the model.