Many good points. I agree with essentially everything you've said, especially regarding relative perplexity. I'm aware that I was aggressively overselling an u

Many good points. I agree with essentially everything you've said, especially regarding relative perplexity. I'm aware that I was aggressively overselling an unnuanced and overstated position on 4-bit and especially 3-bit performance. That was partially a rhetorical tactic to swing the pendulum the other way, as it were. And partially it was simply frustration with the number of threads I've seen in the past week of LLaMA drama spreading misinformation about bit precision like "a 16bit 13B model surely outperforms a 4-bit 30B model" which could not be further from the truth. That frustration is my own responsibility to manage and I understand that.