3 ms·
> ...and repeat, until the model is as tiny as you want. Cool! So if I repeat long enough I can get any network down to a single neuron (as long as I really w
by MarkusQ 6y ago
> ...and repeat, until the model is as tiny as you want.
Cool! So if I repeat long enough I can get any network down to a single neuron (as long as I really want to)? That is awesome!
- fishmaster 6y agoI mean yeah... but the performance will be accordingly.
- mkolodny 6y agoNot quite. The Lottery Ticket Hypothesis paper showed that models could shrink to around 10% of their original size without a loss of accuracy [0]. So around a million neurons instead of 10 million. [0] https://arxiv.org/abs/1903.01611v1 https://arxiv.org/abs/1903.01611v1
- deleted 6y ago[deleted]
- jl2718 6y agoRead the original papers on the perceptron for similar claims.