3 ms·

Interesting post. Curious to know how they arrived at intelligence density = Negative log of the model's error rate divided by the model size.

• Geee 6mo ago
  What is model's error rate?
• cubefox 6mo ago
  See page 10: https://github.com/PrismML-Eng/Bonsai-demo/blob/main/1-bit-bonsai-8b-whitepaper.pdf https://github.com/PrismML-Eng/Bonsai-demo/blob/main/1-bit-b...