4 ms·
and the repo for this project: https://github.com/microsoft/BitNet https://github.com/microsoft/BitNet
by skavi 2y ago
and the repo for this project: https://github.com/microsoft/BitNet https://github.com/microsoft/BitNet
- sinuhe69 2y agoThe demo they showed was full of repeated sentences. The 3B model looks quite dense, TBH. Did they just want to show the speed?
- newswasboring 2y ago3B models, especially in quantized state, almost always behave like this.