32 ms·
Quantization is orthogonal and complementary.
by Eridrus 6y ago
Quantization is orthogonal and complementary.
- natch 6y agoHow so? You still aren't saying what the benefits are. OK, to be fair I said tradeoffs, but I'm really wondering what the point of this work is. I mean my models are ridiculously tiny already, even when considered for use on mobile devices, so clearly that's not the win here. What is?
- Eridrus 6y agoYour models might be ridiculously tiny, but a lot of people's models are not. Take a loot at any research paper in vision, speech or language. The models are gigantic.
- natch 6y agoBut quantization solves the problem of models being gigantic. So the question is still unanswered. But hey, you got in your downvote, thanks for that.