3 ms·
"Another emerging trend introduces sparsity (the presence of zeros) in DNN neurons and weights by techniques such as pruning, ReLU, and ternarization, which can
by sgt101 10y ago
"Another emerging trend introduces sparsity (the presence of zeros) in DNN neurons and weights by techniques such as pruning, ReLU, and ternarization, which can lead to DNNs with ~50% to ~90% zeros. " Does anyone have a reference for this ?
- znfi 10y agoJust randomly googling "ternarization deep learning" lead me to this article from ICLR 2017 https://openreview.net/pdf?id=r1fYuytex https://openreview.net/pdf?id=r1fYuytex which in turn seem to reference further work in the area.
- sgt101 10y agoThanks - I wouldn't have thought of ternarization in the context of sparsity! Good idea :)