GPT doesn't read text. It tries to predict it. Gradient descent prediction is just a dumb optimizer like evolution. Generalization from it, like evolution is br

GPT doesn't read text. It tries to predict it. Gradient descent prediction is just a dumb optimizer like evolution. Generalization from it, like evolution is broad and sweeping rather than exact and pinpoint. Understanding is a spectrum. Yes if it is making moves above random chance, it has a little level of understanding.