2 ms·
Then, could you give an example of a concrete MNIST-like dataset you worked with? Galaxies are not like such (more diverse, more noise, you don't start with ce
by stared 4y ago
Then, could you give an example of a concrete MNIST-like dataset you worked with?
Galaxies are not like such (more diverse, more noise, you don't start with centered images, usually more data - in size and channels).
- p1esk 4y agoAll similarly sparse data samples would suffer from the bachnorm issue. I don’t remember if I tried a convnet with batchnorm on galaxy classification but I did try it on piano rolls - it was bad - precisely because of batchnorm, and had I first tried the same model on mnist I would have caught the issue much faster (I tested it on cifar). I suspect a chess position evaluation would suffer from batchnorm just as much, if the intermediate feature maps remain sparse.