4 ms·
A neuron which rarely fires may be responding to a rare feature, no?
by dTal 3y ago
A neuron which rarely fires may be responding to a rare feature, no?
- radarsat1 3y agoAbsolutely. Pruning can decrease overall accuracy. The challenge is to prune as aggressively as possible while keeping accuracy as high as possible. It's certainly not an operation that is expected to have no effect. It should be noted that there are methods for training the network to encourage these prunable neurons, eg sparsity penalties.