3 ms·
Exactly as xnornet was doing way back in 2016 - shadow 32bit weights, quantized to 1 bit during the forward pass. https://arxiv.org/abs/1603.05279 https://arxi
by buildbot 2y ago
Exactly as xnornet was doing way back in 2016 - shadow 32bit weights, quantized to 1 bit during the forward pass.
https://arxiv.org/abs/1603.05279 https://arxiv.org/abs/1603.05279
I personally have a pretty negative opinion of the bitnet paper.
- llm_trw 2y agoThanks for the citation, I did my work in the area around 2014 and never looked back. That's a very good summary of the state of the field as I remember it.