4 ms·

> but it's impossible for me as an individual to know what your subjective experience of an image looks like This smells like a god of the gaps or argument fro

> but it's impossible for me as an individual to know what your subjective experience of an image looks like This smells like a god of the gaps or argument from ignorance type of argument to me. And it's not impossible, just difficult to execute. All we would have to do is digitize your brain and swap out the responsible part, then you can form a memory of that, swap the original back in and do a comparison. Or something like that. All handwavy science-fiction of course since we currently lack detailed knowledge how this works, but that does not imply there's anything special about it, only that one human might be processing the data slightly differently than another human. The same way that one human may assign a different most-common-meaning to an ambiguous word than another.

ImprobableTruth 6y ago
>This smells like a god of the gaps or argument from ignorance type of argument to me huh? Are you saying that 'we don't know how subjective experience works' is a argument from ignorance? >All we would have to do is digitize your brain and swap out the responsible part, then you can form a memory of that, swap the original back in and do a comparison. I'm not sure what that is supposed to mean. What is 'the responsible part' and what would swapping it out achieve? I'm still only going to have my subjective experience.
- the8472 6y ago
  > huh? Are you saying that 'we don't know how subjective experience works' is a argument from ignorance? I'm saying that the lack of knowledge does not imply that there's anything special about it that wouldn't also arise naturally in an NN approaching even animal intelligence. > What is 'the responsible part' and what would swapping it out achieve? I'm still only going to have my subjective experience. I assume that "subjective experience" has some observable consequences, of which you can form memories. Being able to swap out parts of a brain will allow you to have a different subjective experience and then compare them. It is an experimental tool. I don't know what you will observe since that experiment has not been performed.
  - ImprobableTruth 6y ago
    >Only that there's something special about subjective experience that wouldn't arise naturally in an NN approaching even animal intelligence. That isn't at all what I've said. I'm saying that 'qualia' exist and that we have no clue how they arise. Maybe they arise from complicated enough systems, maybe they don't. Hell, maybe panpsychists are right and even a rock has some sort of consciousness. My issue is with people who are confident that a big enough NN necessarily has consciousness. >I assume that "subjective experience" has some observable consequences, of which you can form memories. Being able to swap out parts of a brain will allow you to have a different subjective experience and then compare them. It is an experimental tool. I don't know what you will observe since that experiment has not been performed. Unless you presuppose that there is some part that completely determines subjective experience (I don't think it'd even be possible to identify such a part if it existed), I don't see how that would work. Yes, you can swap out a part and see that your subjective experience changes, but this tells you nothing about the subjective experience of others.
    - the8472 6y ago
      > I'm saying that 'qualia' exist If by qualia you mean slight differences in information processing in human brains, then sure. If you mean anything more than that I would like a) a better definition than the one I have given b) some observational evidence for its existence. > My issue is with people who are confident that a big enough NN necessarily has consciousness. Not necessarily, just potentially. After all there will be many inefficient/barely-better-than-previously/outright detective big NNs on the path to AGI. If you're asking whether an intelligent NN will automatically be conscious then it depends on what we mean by "intelligent" and "conscious". A mathematical theorem prover may not need many facilities that a human mind has even though it still has to find many highly abstract and novel approaches to do its work. On the other hand an agent interacting with the physical world and other humans will probably benefit from many of the same principles and the mix of them is what we call consciousness. One problem with "consciousness" is that it's such an overloaded term. I recommend decomposing it into smaller features that we care about and then we can talk about whether another system has them. > Hell, maybe panpsychists are right and even a rock has some sort of consciousness. If we twist words far enough then of course they do. They are following the laws of physics after all which is information processing, going from one state to another. But then all physical systems do that and its usually not the kind of information processing we care that much about when talking about intelligences. Technically correct given the premise but useless. > I don't think it'd even be possible to identify such a part if it existed We're already making the assumption we have the technology to simulate a brain. If you have that ability you can also implement any debugging/observational tooling you need. AI research is not blind, co-developing such tooling together with the networks is happening today. https://openai.com/blog/introducing-activation-atlases/ https://openai.com/blog/introducing-activation-atlases/

ImprobableTruth 6y ago

>This smells like a god of the gaps or argument from ignorance type of argument to me huh? Are you saying that 'we don't know how subjective experience works' is a argument from ignorance? >All we would have to do is digitize your brain and swap out the responsible part, then you can form a memory of that, swap the original back in and do a comparison. I'm not sure what that is supposed to mean. What is 'the responsible part' and what would swapping it out achieve? I'm still only going to have my subjective experience.

the8472 6y ago
> huh? Are you saying that 'we don't know how subjective experience works' is a argument from ignorance? I'm saying that the lack of knowledge does not imply that there's anything special about it that wouldn't also arise naturally in an NN approaching even animal intelligence. > What is 'the responsible part' and what would swapping it out achieve? I'm still only going to have my subjective experience. I assume that "subjective experience" has some observable consequences, of which you can form memories. Being able to swap out parts of a brain will allow you to have a different subjective experience and then compare them. It is an experimental tool. I don't know what you will observe since that experiment has not been performed.
- ImprobableTruth 6y ago
  >Only that there's something special about subjective experience that wouldn't arise naturally in an NN approaching even animal intelligence. That isn't at all what I've said. I'm saying that 'qualia' exist and that we have no clue how they arise. Maybe they arise from complicated enough systems, maybe they don't. Hell, maybe panpsychists are right and even a rock has some sort of consciousness. My issue is with people who are confident that a big enough NN necessarily has consciousness. >I assume that "subjective experience" has some observable consequences, of which you can form memories. Being able to swap out parts of a brain will allow you to have a different subjective experience and then compare them. It is an experimental tool. I don't know what you will observe since that experiment has not been performed. Unless you presuppose that there is some part that completely determines subjective experience (I don't think it'd even be possible to identify such a part if it existed), I don't see how that would work. Yes, you can swap out a part and see that your subjective experience changes, but this tells you nothing about the subjective experience of others.
  - the8472 6y ago
    > I'm saying that 'qualia' exist If by qualia you mean slight differences in information processing in human brains, then sure. If you mean anything more than that I would like a) a better definition than the one I have given b) some observational evidence for its existence. > My issue is with people who are confident that a big enough NN necessarily has consciousness. Not necessarily, just potentially. After all there will be many inefficient/barely-better-than-previously/outright detective big NNs on the path to AGI. If you're asking whether an intelligent NN will automatically be conscious then it depends on what we mean by "intelligent" and "conscious". A mathematical theorem prover may not need many facilities that a human mind has even though it still has to find many highly abstract and novel approaches to do its work. On the other hand an agent interacting with the physical world and other humans will probably benefit from many of the same principles and the mix of them is what we call consciousness. One problem with "consciousness" is that it's such an overloaded term. I recommend decomposing it into smaller features that we care about and then we can talk about whether another system has them. > Hell, maybe panpsychists are right and even a rock has some sort of consciousness. If we twist words far enough then of course they do. They are following the laws of physics after all which is information processing, going from one state to another. But then all physical systems do that and its usually not the kind of information processing we care that much about when talking about intelligences. Technically correct given the premise but useless. > I don't think it'd even be possible to identify such a part if it existed We're already making the assumption we have the technology to simulate a brain. If you have that ability you can also implement any debugging/observational tooling you need. AI research is not blind, co-developing such tooling together with the networks is happening today. https://openai.com/blog/introducing-activation-atlases/ https://openai.com/blog/introducing-activation-atlases/