4 ms·
So far this is only shown on TIMIT and MNIST, which are pretty trivial datasets, so it may be dataset dependent. One of the authors is giving a talk at INRIA i
by kastnerkyle 12y ago
So far this is only shown on TIMIT and MNIST, which are pretty trivial datasets, so it may be dataset dependent.
One of the authors is giving a talk at INRIA in France this month, and the abstract mentioned CIFAR10 (possibly unpublished results). If they have manged to compress a CIFAR10 network, that is a strong indicator that ImageNet networks could be compressed in the same way... but no one has published any results in this regard to my knowledge.
However this is an active area of research for me, and I hope to explore it more soon. I think there are better ways to approximate than this, but this work at least shows that it may be possible.