I believe Altman, but the title is misleading. Have we exhausted the value of larger models on current architecture? Probably yes. I trust OpenAI would throw m

I believe Altman, but the title is misleading. Have we exhausted the value of larger models on current architecture? Probably yes. I trust OpenAI would throw more $ at it if there was anything left on the table. Have we been here before? Also yes. I recall hearing similar things about LSTMs when they were in vogue. Will the next game changing architecture require a huge model? Probably. Don’t see any sign these things are scaling _worse_ with more data/compute. The age of huge models with current architecture could be over, but that started what, 5 years ago? Who cares?