4 ms·
For reference, this is a real prototype for Bitnet 1.58b which uses (-1,0,1) as the weights which simplifies the matrix multiplication [0]. [0] https://arxiv.o
by syntaxing 2y ago
For reference, this is a real prototype for Bitnet 1.58b which uses (-1,0,1) as the weights which simplifies the matrix multiplication [0].
[0] https://arxiv.org/abs/2402.17764 https://arxiv.org/abs/2402.17764