3 ms·

AI in general (whether via RL or whichever new development that will surface) opens up a fascinating new arena for learning about how agents operate, and invest

AI in general (whether via RL or whichever new development that will surface) opens up a fascinating new arena for learning about how agents operate, and investigating the soft problem of consciousness (i.e, what are the type of processes and the complexity involved that is required for having an inner experience), but I stand by my assertion that it will never explain the hard problem of consciousness, and no conceptual explanation ever will.

visarga 9y ago
By saying "no conceptual explanation ever will" you put consciousness in a category of its own, supernatural or mysterious, like Chalmers. That's just a soft form of dualism. You have sense organs and sensory cortex that creates representations. Those representations are evaluated subjectively for their utility, thus, generating emotion. This is qualia. What else is there? The fact that it feels like something to see red or blue? That's just sensation + emotional response. I know it feels like I just gave you the soft problem of consciousness instead of the hard problem, but I don't think the hard problem is anything beyond a loop of perceive - evaluate - act - learn in the world. If you want the ontological cause of consciousness, then it must be the environment because the environment teaches the agent perception and values. Values and emotions appear from the game the agent is playing. So the substrate of consciousness is not the brain, but the "game".
- placebo 9y ago
  >By saying "no conceptual explanation ever will" you put consciousness in a category of its own, supernatural or mysterious, like Chalmers. That's just a soft form of dualism. I think you just pointed out the very paradox which illustrates my point: In which category do you place something that cannot belong to any category? At this point you might want to say that I'm just making up an artificial nonexistent construct that has no bearing on reality and my task would be to show that not only does it exist, but it is the very basis necessary for all categories to exist. This thread would probably not suffice to achieve that :-) And by the way, I don't see it as supernatural - if anything, the process of concepts and objects created by an agent to approximate reality and then taking these approximations to be reality is what I find to be supernatural. It amazes me how evolution managed to pull this off... >The fact that it feels like something to see red or blue? That's just sensation + emotional response. I'm suggesting that "just sensation" is a placeholder for "I have no idea what that is"... There's a big difference between the explanation of a process and the experiencing of a process. We are so quick to categorise experiences into concepts and relationships between them that we overlook the fact that the sensory experience exists before any conceptualisation and categorisation, and in a way is much more real than any story we mould it into some milliseconds later (i.e "this is red", "this is cold" etc.) >So the substrate of consciousness is not the brain, but the "game". By now you probably realise (though I assume still disagree with me) that I see it the other way around: i.e that no concept can exist without knowing it. This is not the same as saying nothing exists without our knowledge, but it does mean that what exists before our knowledge of it remains by definition undefinable and inscrutable.
  - visarga 9y ago
    > In which category do you place something that cannot belong to any category? How could something created by a body not belong to any category? It belongs to the category of self-regulated systems adapting to their environment. Creating concepts has been demonstrated since 2012 (Google 'cat detector' https://www.wired.com/2012/06/google-x-neural-network/ https://www.wired.com/2012/06/google-x-neural-network/). In natural language processing, Andrej Karpathy demonstrated in his char-RNN blogpost the emergence of neurons specialized in various concepts (http://karpathy.github.io/2015/05/21/rnn-effectiveness/ http://karpathy.github.io/2015/05/21/rnn-effectiveness/). It happens naturally in deep networks, as lower layer features are combined into higher level features. > I'm suggesting that "just sensation" is a placeholder for "I have no idea what that is"... Ah sorry, I didn't mean "sensation" as in "placeholder for no idea". I meant it as a neural net, the kind we have in our vision system, or the kind used in Deep Learning. They are made of millions of neurons and trained on millions of images to distinguish and localize objects and object relations in images. We have had thousands of papers optimizing on this kind of architecture - Convolutional Neural Network (CNN) - arguably the most successful part of deep learning. Not only that "sensation" was a neural net, but "emotional response" is also a neural net that computes scores of utility of states and actions. So I was referring to concrete concepts. That's what I like about RL compared to philosophy - it replaces vague concepts with concrete models.
    - placebo 9y ago
      It looks like we share a similar enthusiasm for the potential of artificial neural networks (and I also assume a similar distrust in the ability of philosophy to answer these questions), and I agree that NNs are currently the best candidate to eventually create self-conscious machines (though unlike some prominent celebrities, I believe it's still in the far future). The point we depart is that you seem to be saying there is no real difference between the hard problem and the soft problem of consciousness. We obviously mean different things by "sensation": I've implemented neural nets to solve problems using ML, I understand the theory and certainly impressed with the results . I assume that by "sensations" you are referring to the process of inputs entering the input layer of the neural net. This is exactly part of a model for solving the soft problem of consciousness. What I'm getting at is that you know what a sensation feels like before you give it any label - it has a certain "is"ness to it that no equation or concept can convey. I'm saying this becomes possible when a system becomes complex enough to be self-conscious and it is usually attributed as some sort of emergent property that is created by the system, whereas I claim it is much deeper than that, and in fact it is the other way around. Obviously this correspondence format is not really suited to dive deeper, but I'm always happy to discuss this to find if and where I'm mistaken.

visarga 9y ago

By saying "no conceptual explanation ever will" you put consciousness in a category of its own, supernatural or mysterious, like Chalmers. That's just a soft form of dualism. You have sense organs and sensory cortex that creates representations. Those representations are evaluated subjectively for their utility, thus, generating emotion. This is qualia. What else is there? The fact that it feels like something to see red or blue? That's just sensation + emotional response. I know it feels like I just gave you the soft problem of consciousness instead of the hard problem, but I don't think the hard problem is anything beyond a loop of perceive - evaluate - act - learn in the world. If you want the ontological cause of consciousness, then it must be the environment because the environment teaches the agent perception and values. Values and emotions appear from the game the agent is playing. So the substrate of consciousness is not the brain, but the "game".

placebo 9y ago
>By saying "no conceptual explanation ever will" you put consciousness in a category of its own, supernatural or mysterious, like Chalmers. That's just a soft form of dualism. I think you just pointed out the very paradox which illustrates my point: In which category do you place something that cannot belong to any category? At this point you might want to say that I'm just making up an artificial nonexistent construct that has no bearing on reality and my task would be to show that not only does it exist, but it is the very basis necessary for all categories to exist. This thread would probably not suffice to achieve that :-) And by the way, I don't see it as supernatural - if anything, the process of concepts and objects created by an agent to approximate reality and then taking these approximations to be reality is what I find to be supernatural. It amazes me how evolution managed to pull this off... >The fact that it feels like something to see red or blue? That's just sensation + emotional response. I'm suggesting that "just sensation" is a placeholder for "I have no idea what that is"... There's a big difference between the explanation of a process and the experiencing of a process. We are so quick to categorise experiences into concepts and relationships between them that we overlook the fact that the sensory experience exists before any conceptualisation and categorisation, and in a way is much more real than any story we mould it into some milliseconds later (i.e "this is red", "this is cold" etc.) >So the substrate of consciousness is not the brain, but the "game". By now you probably realise (though I assume still disagree with me) that I see it the other way around: i.e that no concept can exist without knowing it. This is not the same as saying nothing exists without our knowledge, but it does mean that what exists before our knowledge of it remains by definition undefinable and inscrutable.
- visarga 9y ago
  > In which category do you place something that cannot belong to any category? How could something created by a body not belong to any category? It belongs to the category of self-regulated systems adapting to their environment. Creating concepts has been demonstrated since 2012 (Google 'cat detector' https://www.wired.com/2012/06/google-x-neural-network/ https://www.wired.com/2012/06/google-x-neural-network/). In natural language processing, Andrej Karpathy demonstrated in his char-RNN blogpost the emergence of neurons specialized in various concepts (http://karpathy.github.io/2015/05/21/rnn-effectiveness/ http://karpathy.github.io/2015/05/21/rnn-effectiveness/). It happens naturally in deep networks, as lower layer features are combined into higher level features. > I'm suggesting that "just sensation" is a placeholder for "I have no idea what that is"... Ah sorry, I didn't mean "sensation" as in "placeholder for no idea". I meant it as a neural net, the kind we have in our vision system, or the kind used in Deep Learning. They are made of millions of neurons and trained on millions of images to distinguish and localize objects and object relations in images. We have had thousands of papers optimizing on this kind of architecture - Convolutional Neural Network (CNN) - arguably the most successful part of deep learning. Not only that "sensation" was a neural net, but "emotional response" is also a neural net that computes scores of utility of states and actions. So I was referring to concrete concepts. That's what I like about RL compared to philosophy - it replaces vague concepts with concrete models.
  - placebo 9y ago
    It looks like we share a similar enthusiasm for the potential of artificial neural networks (and I also assume a similar distrust in the ability of philosophy to answer these questions), and I agree that NNs are currently the best candidate to eventually create self-conscious machines (though unlike some prominent celebrities, I believe it's still in the far future). The point we depart is that you seem to be saying there is no real difference between the hard problem and the soft problem of consciousness. We obviously mean different things by "sensation": I've implemented neural nets to solve problems using ML, I understand the theory and certainly impressed with the results . I assume that by "sensations" you are referring to the process of inputs entering the input layer of the neural net. This is exactly part of a model for solving the soft problem of consciousness. What I'm getting at is that you know what a sensation feels like before you give it any label - it has a certain "is"ness to it that no equation or concept can convey. I'm saying this becomes possible when a system becomes complex enough to be self-conscious and it is usually attributed as some sort of emergent property that is created by the system, whereas I claim it is much deeper than that, and in fact it is the other way around. Obviously this correspondence format is not really suited to dive deeper, but I'm always happy to discuss this to find if and where I'm mistaken.