You don't necessarily know, but the unlikeliness of this occurring in the training images and the structure of the neural net making it difficult for the net to

You don't necessarily know, but the unlikeliness of this occurring in the training images and the structure of the neural net making it difficult for the net to learn to even or oddness of the number of pixels makes one reasonably confident.