Well, to a degree, because we just don't do science like that. You're the one supposing a thing, so the burden of proof is on you. You need to demonstrate tha

Well, to a degree, because we just don't do science like that. You're the one supposing a thing, so the burden of proof is on you. You need to demonstrate that the "incredibly complicated behaviour" that you're referring to (I assume this is longhand for "thinking", but please correct me if I'm wrong) is indeed emerging from matrix multiplication. Especially given that what you're suggesting is unexpected, given the known way these models work and the explanations that have been put forth already that extrapolate from the known way these models work. If science were so credulous as to accept the first proffered theory about a new development, well, we wouldn't have these interesting AI models in the first place!