4 ms·
This paper had trouble getting this to work with lager models I believe. https://arxiv.org/abs/1902.09574 https://arxiv.org/abs/1902.09574
by hnaccy 7y ago
This paper had trouble getting this to work with lager models I believe.
https://arxiv.org/abs/1902.09574 https://arxiv.org/abs/1902.09574
- p1esk 7y agoYou mean this one https://arxiv.org/abs/1903.01611 https://arxiv.org/abs/1903.01611 ?
- hnaccy 7y agoNo. From my link: >Additionally, we provide strong counterexamples to two recently proposed theories that models learned through pruning techniques can be trained from scratch to the same test set performance of a model learned with sparsification as part of the optimization process. Our results highlight the need for large-scale benchmarks in sparsification and model compression.