These language model-based AIs are fundamentally limited, they are very impressive for what they can do, but they are at the end of the day just search engines

These language model-based AIs are fundamentally limited, they are very impressive for what they can do, but they are at the end of the day just search engines trained on a litany of data that can form your question cleverly to look up its internal knowledge base and transform the output in a way that sort of makes sense. But it will not come up with any novel solutions to problems any time soon. E.g. I asked it whether 23 is a prime number and while it could state correctly that it only has two divisors, it failed to reason that it thus must be a prime number (even though it itself gave this definition).