4 ms·
Well, there are long standing network pruning techniques like Optimal Brain Damage (1990) [1] and Optimal Brain Surgeon [2]. Could you be more concrete about wh
by _0ffh 7y ago
Well, there are long standing network pruning techniques like Optimal Brain Damage (1990) [1] and Optimal Brain Surgeon [2]. Could you be more concrete about what you would be trying to do?
[1] https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.32.7223 https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.32....
[2] https://papers.nips.cc/paper/647-second-order-derivatives-for-network-pruning-optimal-brain-surgeon.pdf https://papers.nips.cc/paper/647-second-order-derivatives-fo...
- bayesian_horse 7y agoI didn't invest any serious work in this idea, and didn't even research if somebody has come up with such things before.