I think it's quite amusing that despite being a "only" a language model that generates text by prediction, it's so good at it that it successfully tricks people

I think it's quite amusing that despite being a "only" a language model that generates text by prediction, it's so good at it that it successfully tricks people into believing it's some kind of AGI that can figure out the "real" answer to anything and do any task and then when it inevitably "fails" a task, people say it's dumb. But I do agree that for people who understand how it works, it's a bit weird not to be impressed that a language model has the ability to have such good understanding of things and such intriguing capabilities when it's fundamentally just predicting the next token.