2 ms·
> This basically shows over 50% of the neural net is gibberish! The reason being is that the objective function simply does not include it. This is a mischarac
by sitkack 2y ago
> This basically shows over 50% of the neural net is gibberish! The reason being is that the objective function simply does not include it.
This is a mischaracterization of sparsity. Performance did drop, so the weights are not gibberish. Training vs pruning, you can't train into the final state, you can only prune there.