LLMs haven't been improving for years. Despite all the productizing and the benchmark gaming, fundamentally all we got is some low-hanging performance improvem

LLMs haven't been improving for years. Despite all the productizing and the benchmark gaming, fundamentally all we got is some low-hanging performance improvements (MoE and such).