3 ms·
> Making subtle changes to images, text, or audio can fool these systems into perceiving things that aren’t there. This isn't a hallucination problem. It is a
by dwaltrip 9y ago
> Making subtle changes to images, text, or audio can fool these systems into perceiving things that aren’t there.
This isn't a hallucination problem. It is a robustness issue.
The outputs of modern AI lack conceptual depth and substance. These algorithms produce very shallow categorizations that are only useful in narrow, constrained contexts. Not surprisingly, it isn't hard to break or hack these fragile categorizations.
Sure, one could potentially argue that this has some similarity to human hallucinations, but I think that is a needless distraction. We know with great certainty that our AI techniques don't have the robustness and generality of animal intelligence. We are much less certain about the causes of human mental illness and any resulting hallucinations, so that analogy doesn't really lead us in a productive direction.