> If you only train it on examples of 0-9 then those are the only outputs it's going to give. Exactly. > 11 outputs: 0-9 and "non-digit" IIRC, this doesn't w

> If you only train it on examples of 0-9 then those are the only outputs it's going to give. Exactly. > 11 outputs: 0-9 and "non-digit" IIRC, this doesn't work (or not well) because the net tries to find similarities between the various members of the set "everything except these ten specific things", but you could just require low confidence for all digits on non-digit inputs as part of the gradient descent function. The problem is more that - if people with decision-making authority trust the AI to not be insane and evil by default - failure modes like this have to occur to you before the AI starts misbehaving in production.