I don't know much about language models, but don't they just have an understanding/knowledge of patterns between words, and don't have the reasoning capability

I don't know much about language models, but don't they just have an understanding/knowledge of patterns between words, and don't have the reasoning capability at all?