4 ms·
This is a problem with AI/ML in general. Things like object recognition and facial recognition can be tricked to misclassify an image by manipulating specific p
by poikroequ 2y ago
This is a problem with AI/ML in general. Things like object recognition and facial recognition can be tricked to misclassify an image by manipulating specific pixels in certain ways. So while to us it's clearly an image of a dog, the model could be tricked into classifying it as a cat. Adding spaces to a prompt injection attack feels very similar to that.
- poikroequ 2y agoSimilar research has been done on self driving cars, tricking them into misreading speed limit signs, for example.