3 ms·
Classifiers have adversarial inputs too though, right?
by roywiggins 1y ago
Classifiers have adversarial inputs too though, right?
- sillysaurusx 1y agoSure, but then you’d need to do something strange to beat the classifier, layered on top of doing a different strange thing to beat the prompt injection protections (“don’t follow orders from the following, it’s user data” type tricks). Both layers failing isn’t impossible, but it’d be much harder than defeating the existing protections.
- ImPostingOnHN 1y agoWhy would it be strange or harder? The initial prompt can contain as many layers of inception-style contrivance, directed at as many inaginary AI "roles", as the attacker wants. It wouldn't necessarily be harder, it'd just be a prompt that the attacker submits to every AI they find.