The reason why AI community says NN doesn't "think" lies in the fact that it's trying to solve some min-max problem. The modern day AI is extremely capable of d

The reason why AI community says NN doesn't "think" lies in the fact that it's trying to solve some min-max problem. The modern day AI is extremely capable of doing things that weren't remotely possible 30 yrs ago. But it is equally difficult for it to think because it has never been taught to think. It has never been taught to rationalize the associations between different objects, how reasoning follows from it and so on. Think of it as a parrot. If you say some word to parrot, it can repeat it. Occasionally it can make weird sounds. But will it know the idea of big words that we use in our vocabulary? Not at all. Likewise language models are over fitted on human language. Of course it will learn to spit out something because it was trained to do the exact same thing. Focus on relevant part and guess what follows. The best part is this idea is so simple that it just works! It does what we want to do, it can take a good educated guess depending on word. But give it a long context like an essay and ask it some critical question, it will fail on those. Because that is where thinking comes in. I hope this probably gives you some different perspective.