Exactly. Especially because we don't have any convincing explanation of how the models develop emergent abilities just from predicting the next word. No one ex

Exactly. Especially because we don't have any convincing explanation of how the models develop emergent abilities just from predicting the next word. No one expected that, i.e., we greatly underestimated the power of predicting the next word in the past; and we still don't have an understanding of how it works, so we have no guarantee that we are not still underestimating it.