3 ms·
They do not have perplexity numbers for the larger models (see Table 2), only speed and memory benchmarks.
by sp332 3y ago
They do not have perplexity numbers for the larger models (see Table 2), only speed and memory benchmarks.
- imjonse 3y agoYou're both right, I skimmed the paper, saw large model numbers but didn't notice it was for speed. On the HF page they say those models are being trained. https://huggingface.co/papers/2402.17764 https://huggingface.co/papers/2402.17764 "We haven't finished the training of the models beyond 3B as it requires much much more resources. However, we're optimistic about the results because we have verified that BitNet follows a similar performance-parameter scaling law as the full-precision LLMs. We'll update the results on larger models once they're ready."