> why did no one come up with this before? And because the effects of the problem are subtle. Supposing the diagnosis is correct, full-precision LLMs still av

> why did no one come up with this before? And because the effects of the problem are subtle. Supposing the diagnosis is correct, full-precision LLMs still avoid the issue through large attention weights given to meaningless tokens to give harmless attention outputs. The problem only matters when quantizing weights, and quantized performance isn't really the goal of recent cutting-edge LLM development.