Well, you could also implement this by hand-writing weights for one convolution layer. There are only 512 training examples needed for that, and it would be a

Well, you could also implement this by hand-writing weights for one convolution layer. There are only 512 training examples needed for that, and it would be a lot more interesting if a learning algorithm were able to fit that 3x3 convolution layer from those 512 examples. IIRC, and don't quote me on that, but that's not been done.