4 ms·
People have been doing this 6 years ago. https://github.com/yashkant/quantized-nets https://github.com/TropComplique/trained-ternary-quantization h
by jdthedisciple 3y ago
People have been doing this 6 years ago.
https://github.com/yashkant/quantized-nets
https://github.com/TropComplique/trained-ternary-quantization
https://github.com/buaabai/Ternary-Weights-Network
I too find it very interesting.
But why this sudden, renewed fuzz?
- imtringued 3y agoProbably because despite the 1200 citations, they didn't have the ability to apply it to modern LLMs. Nobody cares about an image classifier using 50% less parameters since most of them were small enough to fit in memory anyway.
- gerash 3y agoI haven't read the paper but I clearly remember 1-bit quantization from at least 5-6 years ago