The progress is exponential, but the noticeable impact scales linearly with exponential improvement. Case in point, LLM's only get linearly better on benchmarks

The progress is exponential, but the noticeable impact scales linearly with exponential improvement. Case in point, LLM's only get linearly better on benchmarks with exponential increase in parameter count.