> These findings are in line with “The Lottery Ticket Hypothesis,” If the fit was due to a lucky subset of weights you could have train smaller networks many t

> These findings are in line with “The Lottery Ticket Hypothesis,” If the fit was due to a lucky subset of weights you could have train smaller networks many times instead of using many times bigger network. So it must be something more. Like increased opportunity to create best solution out of large number of random lucky parts. I think there should be way more research on neural pruning. After all it's what our brains do to reach the correct architecture and weights during our development.