This is a nice result. I'm sure a lot of people had this particular idea but never got to actually do it. Not surprising because this is actually why to human b

This is a nice result. I'm sure a lot of people had this particular idea but never got to actually do it. Not surprising because this is actually why to human brain scales so well. This was also hinted by AutoEncoders where pieces of a net are built separately bottom-up. I'm guessing a final settling phase would also be useful here. One unfortunate thing is that different runs will produce different nets. But if training is radically faster and accuracy differences are small than this is one new technique to add to the toolbox.