> Will that continue forever and we keep getting more impressive emergent behaviors from it? I doubt that I feel like putting the word 'forever' ruins the poin

> Will that continue forever and we keep getting more impressive emergent behaviors from it? I doubt that I feel like putting the word 'forever' ruins the point. It's the most extreme strawman. It's amazing how the scaling has unlocked the emergent behaviors! When I look at the scaling graphs, I see that the ability to reduce 'perplexity' is continuing with scale and capital investment with no sign of slowing yet (it will slow eventually). I also see that reducing perplexity is continually unlocking new emergent behaviors. So I would guess that scaling will probably unlock so many more new emergent behaviors before it eventually plateaus!