I'm a bit late on this one but I'll write my thoughts here in an attempt to archive my them (but still leave the possibility for someone to chip in). LLMs are

I'm a bit late on this one but I'll write my thoughts here in an attempt to archive my them (but still leave the possibility for someone to chip in). LLMs are trying to predict the next word/token and are asked to do just that, ok. But, I'm thinking that with a dataset big enough (meaning, containing a lot of different topics and randomness, like the one used for GTP-N) in order to be good at predicting the next token internally the model needs to construct something (a mathematical function) and this process can be assimilated to intelligence. So predicting the next token is the result of intelligence in that case. I find it similar to the work physicist (and scientists in general) are doing for example. Gathering facts about the world and constructing mathematical models that best encompass these facts in order to predict other facts with accuracy. Maybe there is a point to be made that this is not the process of intelligence but I believe it is. And LLMs are doing just that, but for everything. The formula/function is not the intelligence but the product of it. And this formula leads to intelligent actions. The same way our brain has the potential to receive intelligence when we are born and most of our life is spent forming this brain to make intelligent decisions. The brain itself and its matter is not intelligent, it's more the form it eventually takes that leads to an intelligent process. And it takes its form by being trained on live data with trial and error, reward and punishment. I believe these LLMs possess real intelligence that is not in essence different than ours. If there was a way (that cannot scale at the moment) to apply the same training with movement, touch and vision at the same time, that would lead to something indistinguishable from a human. And if one were to add the fear of death on top of that, that would lead to something indistinguishable from consciousness.