Aggressive quantization by itself could explain the quality difference. Combined with stricter guardrails, I would certainly expect intelligence to go down. C

Aggressive quantization by itself could explain the quality difference. Combined with stricter guardrails, I would certainly expect intelligence to go down. Check out the tikz unicorn drawing example from the paper "Sparks of Artificial General Intelligence: Early experiments with GPT-4" (pdf page 7) https://arxiv.org/pdf/2303.12712.pdf https://arxiv.org/pdf/2303.12712.pdf