I know there are 1-bit experiments out there but from what I can tell it's BitNet 1.58 that's really exciting. So why do people keep focusing on "1-bit" when t

I know there are 1-bit experiments out there but from what I can tell it's BitNet 1.58 that's really exciting. So why do people keep focusing on "1-bit" when the whole reason 1-trit models are so successful in the first place just might have everything to do with the ternary weights and the symmetry they're able to encode? I'm not sold on the suggestion that "imprecise language models" in general are "nearly as accurate" when it might actually be that ternary weights are more precise in a totally difference sense: in that they just might be capturing a minimal representation of the very symmetries responsible for making all those parameters effective in the first place.