There is an early shock that happens when you interact with a deep learning model and it is convincingly human in a profound way. And I admit, it is quite prof

There is an early shock that happens when you interact with a deep learning model and it is convincingly human in a profound way. And I admit, it is quite profound that a model is capable of outputting the above. It is objectively exciting. We are in a new era. But, I think it is safe to say that these models are still not sentient. The model is trained to be highly plausible. To do so, it must try to contain the entire dataset into a model that will fit in the video memory of a GPU (16-80GB). In order to do so, it will learn common statistics _between_ data points and make strategic "guesses" instead. I think this bares resemblance to my instincts about how humans probably deal with language (to a degree). But it just doesn't cover all the other parts of cognition. There is no "self awareness" mechanism, it just seems to because it was explicitly trained on text written by, well, humans. There is no "planning" subsystem, meaning it needs a human operator to even initiate it in useful ways. it is not able to "passively think" when it isn't running. It has a very small memory of a few thousand tokens - this deeply inhibits the ability to plan for long time horizons.It also cannot bootstrap itself into awareness, as its weights are unchanged in response to a given prompt. But it's fascinating, nonetheless.