> But I don't get why they would degrade quality? There are two likely reasons: efficiency and "alignment". To make models more efficient, you have to reduce

> But I don't get why they would degrade quality? There are two likely reasons: efficiency and "alignment". To make models more efficient, you have to reduce computation burden. This can be accomplished via quantization and pruning, both of which will reduce computation at the expense of perplexity. Alignment (censoring by another name) also reduces perplexity as we attempt to coerce a model from its ground state into some more socially acceptable version.