3 ms·
So for the uninitiated (me), does this mean the input is not a float (i.e. is quantized on input), such that all the math can be done with int operations? This
by elromulous 3y ago
So for the uninitiated (me), does this mean the input is not a float (i.e. is quantized on input), such that all the math can be done with int operations?
This seems almost too good to be true.
Edit:
Answering my own question, yes.
The details are in the original bitnet paper:
https://arxiv.org/abs/2310.11453 https://arxiv.org/abs/2310.11453