3 ms·
Ten years ago I was a big fan of IIT and Giulio Tononi. But today, I prefer the reinforcement learning paradigm. It's much more powerful. Instead of consciousne
by visarga 9y ago
Ten years ago I was a big fan of IIT and Giulio Tononi. But today, I prefer the reinforcement learning paradigm. It's much more powerful. Instead of consciousness, we have agents that perceive the environment and act, in order to maximize rewards. Agents are also endowed with the power to simulate / imagine possible futures so they can plan and reason. An agent is something concrete, consciousness doesn't even have a definition, that is why I appreciate the RL paradigm. It brings concreteness to an almost metaphisical research topic.
- neuronexmachina 9y agoWhat you describe reminds me of Marvin Minsky's 1986 Society of Mind theory: https://en.wikipedia.org/wiki/Society_of_Mind https://en.wikipedia.org/wiki/Society_of_Mind > A core tenet of Minsky's philosophy is that "minds are what brains do". The society of mind theory views the human mind and any other naturally evolved cognitive systems as a vast society of individually simple processes known as agents. These processes are the fundamental thinking entities from which minds are built, and together produce the many abilities we attribute to minds. The great power in viewing a mind as a society of agents, as opposed to the consequence of some basic principle or some simple formal system, is that different agents can be based on different types of processes with different purposes, ways of representing knowledge, and methods for producing results. > This idea is perhaps best summarized by the following quote: "What magical trick makes us intelligent? The trick is that there is no trick. The power of intelligence stems from our vast diversity, not from any single, perfect principle." —Marvin Minsky, The Society of Mind, p. 308
- orthoganol 9y agoI'm excited about the latest developments in AI too, but RL and consciousness are pretty extreme apples and oranges. I agree with Searle that it's a bit insane to wave away the role or even existence of consciousness ('metaphysical topic', etc.), especially in the context of developing a stronger AI. Just because we don't yet have a mapping of consciousness to types of structures, virtual or otherwise, that could be implemented in an AI system, doesn't mean we should pretend like we've moved beyond it.
- bykovich2 9y agoIsn't this explicitly not a theory of consciousness?
- wxs 9y ago> of consciousness, we have agents that perceive the environment and act, in order to maximize rewards I don't believe "agents acting to maximize rewards" is a good description of any human I know, or if it is the reward function is certainly unknown.
- visarga 9y ago> if it is the reward function is certainly unknown It is a collection of reward channels related to the functioning of the body (food, shelter), learning (curiosity), socializing (and physical touch), physical integrity (avoiding harm). Even newborn babies like to be held and are curious about objects around them - they are already learning to maximize rewards.
- KingMob 9y agoUm, "agents that perceive the environment" sounds a lot like homunculi, which effectively just punts the Hard Problem downstream, but doesn't address it. This is no different in essence than Searle's Chinese Room problem, which at its core asks "If the parts aren't conscious, how can the gestalt be?" We don't have an answer, but it must be true as long as the brain is involved. Individual neurons are unconscious electrochemical devices, but they still add up to experiencing the redness of red.
- dragonwriter 9y ago> This is no different in essence than Searle's Chinese Room problem, which at its core asks "If the parts aren't conscious, how can the gestalt be?" The answer to that question is “consciousness is a property of the interaction between the parts, not of the individual parts.” Or, alternatively, “consciousness is not a well-defined objective property, just a vague incoherent concept that has lots of emotional attachment, but which you can't analytically say is or is not present in any entity or aggregate.” The Chinese Room is useless as anything other than an as an overly elaborate illustration that there isn't a useful, clear understanding of what “consciousness” means.
- visarga 9y agoMy take on the Chinese Room: it is a failed mental experiment. CR differs from humans by embodiment - namely - humans are agents in an external world, with certain limitations, such as need for food, shelter and avoiding pain and injury, which a room doesn't have. Thus the CR can't learn the same value system as a human. The CR has nothing on the line, humans have the protect their life. By removing the world itself from the CR, it is limited in its growth. The world allows for exploration and testing of hypothesis. The CR can't self reproduce, humans can - and reproduction brings a whole list of new constraints for humans that guide evolution. Genetic evolution is also a meta-learning algorithm that the CR lacks. Humans are born with a set of instinctive values which guide the evolution of the brain - like a program. CR has no such initial values (reward channels) and more generally, the problem of learning in CR is glossed over. Searle should have compared humans with a frail robot that has to earn its electricity and raw materials to produce spare parts by its own endeavor, and be able to learn from and teach its knowledge to other robots. Such a robot might have a closer to human perspective on the world, being embodied and subject to limitations that force it to learn intelligent action.