2 ms·
They had to train the various pruned nets 15+ times each to know the cutoff to be a success... Also what is a strong subnetwork? What we get to know it's that
by AstralStorm 7y ago
They had to train the various pruned nets 15+ times each to know the cutoff to be a success...
Also what is a strong subnetwork? What we get to know it's that their pruning algorithm produces a network that is vulnerable to weight randomization but better performing with original weights.
If there is a better pruning algorithm, it could tell us more about structure of such subnetworks.