Yep, the leap away from this exponential blowup is what has made LLMs possible. A few more leaps and we should eventually get models small enough to get close

Yep, the leap away from this exponential blowup is what has made LLMs possible. A few more leaps and we should eventually get models small enough to get close to information theoretic lower bounds of compression.