Funny thing, in 2023 it takes a 8000 word essay (45Kb) to convey why chatGPT's essay is not really an essay. A mere 5 years ago this would have been sci-fi terr

Funny thing, in 2023 it takes a 8000 word essay (45Kb) to convey why chatGPT's essay is not really an essay. A mere 5 years ago this would have been sci-fi territory. > But it is only pretend, there is no mind there and that is the key to understanding what ChatGPT is (and thus what it is capable of). This is where an educator thinks they know AI better than people who work on it. A-priori decision it can't work. What they miss when they do that is the special quality of the training set. Language has special properties that lead to the emergence of abilities previously only possible for humans. Humans for example like to read fiction. It's all pretend, but enjoyable, maybe also instructive. We can simulate other people and their actions, we can infer their emotional states and motives. But it's still all pretend. What if language models can do the same - infer our emotional states, and respond in kind? It would be like generating a novel, something it has seen plenty of in the training data. The magic dust is not in the model and the next token prediction task, but in what data the model was trained on. Our language, our mind stream, taken from real experiences. Language has the ability to create things like chatGPT, language can create modern capable humans from just babies. The author missed language and only saw flaws on the model. Already, by coupling search with language model like bingChat we see even more extreme cases. Now it knows you said things about it on Twitter. These are already going beyond pure LLM. They are going to have a whole host of apps: calculator, calendar, search engine, python and JS execution engines, simulators, recursive calls, language chains, games, memory modules, episodic memory, knowledge bases, etc. I call this paradigm "language model with toys". And they will have this discussion and all the other discussions about it in the next training corpus, thus gaining a way to create a Self. It will have a self because we talk about it like a human.