2 ms·
the thing is that we don't yet know how to implement llm_escape_string()
by Szpadel 3y ago
the thing is that we don't yet know how to implement llm_escape_string()
- pixl97 3y agoDidn't MGM just have a human_agent_escape_string() attack?
- joshuanapoli 3y agoThe instructions and data, input and output are all mixed into a single domain. So we end up with similar weaknesses as simple processors. And similar to how we all get tripped up by phishing. So we need memory protection. Or MFA.
- kromem 3y agoWe broadly do. It's called multiple passes. It's just 2-3x more expensive to run a prompt and then the prompt and response though a secondary fine tuned model to detect injection when the cost is so low impact. So no one is doing it.