4 ms·
In undergrad, some of us math majors would joke that there's really only three quantities: 0, 1, infinity. So, do we need the -1, and/or would a 2.32 bit (5 st
by AaronFriel 3y ago
In undergrad, some of us math majors would joke that there's really only three quantities: 0, 1, infinity.
So, do we need the -1, and/or would a 2.32 bit (5 state, or 6 with +/-0) LLM perform better than a 1.58 bit LLM?