56 ms·
The new model they just released has impressive benchmark results: https://huggingface.co/microsoft/bitnet-b1.58-2B-4T https://huggingface.co/microsoft/bitnet-b
by gardnr 7mo ago
The new model they just released has impressive benchmark results: https://huggingface.co/microsoft/bitnet-b1.58-2B-4T https://huggingface.co/microsoft/bitnet-b1.58-2B-4T
Except on GSM8K and math...
- naasking 7mo agoThanks for the link, the GSM8K result actually leads the pack in that table, but math is indeed underwhelming. Qwen 2.5 is in the lead, but bitnet isn't far behind and it takes 1/6th as much memory during inference, and was trained on less than 1/4 the number of tokens. Pretty cool.
- xenonite 7mo agoThanks, but where did you actually find the new model? The newest one seems to be 11 months old, from Apr 15, 2025.
- naasking 7mo agoI don't think there is a new model, they recently released a new inference engine for CPUs for bitnet models: https://github.com/microsoft/BitNet/blob/main/src/README.md https://github.com/microsoft/BitNet/blob/main/src/README.md