3 ms·
> There was that recent paper titled "The Era of 1-bit LLMs" [0] which was actually suggeting a 1.58 bit LLM (2 bits in practice). 1 trit, not 2 bits. 3 trits
by anticensor 2y ago
> There was that recent paper titled "The Era of 1-bit LLMs" [0] which was actually suggeting a 1.58 bit LLM (2 bits in practice).
1 trit, not 2 bits. 3 trits are 27 states, which can be represented with 5 bits.