3 ms·
>> We've seen ~200MB production models get down to ~4MB and not lose much precision. Details please. What techniques are used to reduce the model size?
by niyazpk 9y ago
>> We've seen ~200MB production models get down to ~4MB and not lose much precision.
Details please. What techniques are used to reduce the model size?
- hidenotslide 9y agoI saw a talk on this paper a couple years ago. https://arxiv.org/abs/1503.02531 https://arxiv.org/abs/1503.02531 The method is to train a smaller model on the predictions of a large model or ensemble. I'd be interested in knowing other techniques as well.