3 ms·

Can you prove you are not merely mimicking consciousness? At some point mimicking a thing becomes the thing.

goatlover 2mo ago
Consciousness isn't behavioral, which is why we can't prove anyone other than ourselves is conscious. Mimicking isn't going to work. But if you want a more scientific reason, LLMs don't have bodies, thus no sensations. What woult it mean for an LLM to feel hungry or cold?
- kelseyfrog 2mo ago
  So if we embodied them, they would become conscious? I feel like the answer would still be no. There would be another gap. We'd ask the question again, "If they had Y, would they be conscious?" and still the answer would be no. We could keep going on forever, which makes me think, it's not really about these gaps at all. It's an ontological distinction swapping in reasons in order to justify itself. Why not just say, "Human consciousness is ontologically axiomatic," and leave it at that?
  - mindcrime 2mo ago
    Why not just say, "Human consciousness is ontologically axiomatic," and leave it at that? OK, but why does "human consciousness" even need to enter into it? What I mean is, what's our basis for demanding that the consciousness of an Artificial Intelligence be the same kind of consciousness as that of a human?
    - kelseyfrog 2mo ago
      I think you would have to justify why humans share a kind of consciousness that is tangibly different from AI while maintaining that we have no apparent means of discriminating between the two. It would seem that it's a difference without meaning.
      - mindcrime 2mo ago
        while maintaining that we have no apparent means of discriminating between the two. Yeah, and that's part of what makes this whole conversation so frustrating. And maybe also pointless in the end. We have a hard time even establishing for certain that we ourselves are conscious. Even more so that "each other" are conscious. Now extend it to some "artificial thing" running on an entirely different substrate and... all bets are off. My argument though, is not that "AI's are conscious" or even that "AI's will definitely become conscious". I just have an issue with fervent assertions that say "No, AI's cannot become conscious" while not really providing any particular justification for that position. I think a more neutral "wait and see" position is more honest.
    - arxell 2mo ago
      The basis is that this is what we know to be human consciousness is to a degree relateably similar to our own. I do see your point but IMO, a dramatically different form of 'consciousness' comes with the risk of being something completely different from what we consider 'consciousness'. One of the great challenges with speaking about 'Self-awareness' aka consciousness (sometimes incorrectly confused with sentience, sapience, phenomenal experience etc) in AI is that we largely lack the vocabulary to properly capture the mutli-dimensional phenomena that most understand simply as 'consciousness'. IMHO, an ant or dog is 'conscious' in that it can perceive the outside world and make decisions about how to respond to it or operate within it... but we know that we operate at a different level of self-awareness including metacognition. Other forms of 'consciousness' will certainly manifest in future AI systems and perhaps already have but the models and architectures of today lack a number of key features that a human like consciousness would be based upon... a short list might include a persistent, unified self-model across time; continuous learning and development, embodied perception, interaction with the world; intrinsic goals, drives, emotions and deeply integrated metacognition—awareness of its own thoughts, uncertainty, attention, and intentions.
      - TheScienceMan 2mo ago
        [dead]
  - exe34 2mo ago
    > Why not just say, "Human consciousness is ontologically axiomatic," and leave it at that? I have no need of that hypothesis.
    - kelseyfrog 2mo ago
      Do you not think humans are conscious?
      - exe34 2mo ago
        I think consciousness is a redundant magical word for a bag of things that most mammals do to varying degree.
        goatlover 2mo ago
        What's magical about subjective experience? We all have them, they're the basis for having any empirical descriptions of the world.
        exe34 2mo ago
        What does subjective experience mean in this context?
        goatlover 2mo ago
        Your own experiences. Nobody else has direct access to them.
        exe34 2mo ago
        That sounds like a measurement problem.
- childintime 2mo ago
  We will be it's body, it will sense through us.
- arde 2mo ago
  The body is the mind's interface with the world. Why couldn't a digital mind "feel sensations", subjective as they are, on its own interface with it? If it's assumed to not be a subject, then how could it be a mind at all?
  - goatlover 2mo ago
    I didn't say AIs couldn't be conscious, only that mimicking behavior (or speech) is not a way to become conscious.
    - arde 2mo ago
      I'm sorry, then what was that "more scientific" reason you gave for?
      - goatlover 2mo ago
        Lack of sensory organs due to lack of a body. A sophisticated enough robot might be able to have conscious experience. That gets into the harder problem that Ned Block laid out where we don't know whether consciousness is biological or functional.
- anthonyrstevens 2mo ago
  >> What woul[d] it mean for an LLM to feel hungry or cold? What would it mean for a human to feel the passing through our bodies of 100 trillion neutrinos every second? My point is that there are things we cannot "feel" either. Why should consciousness depend on certain feelings and not others?
  - goatlover 2mo ago
    Because we don't have a sensory organ for neutrinos. LLMs have no sensory organs, they just emit tokens.
- grantcas 2mo ago
  [dead]
GPerson 2mo ago
You can say that but it doesn’t make it true. The reductive approach to consciousness involves forgetting it is reductive and then boldly asserting its own correctness.
- arde 2mo ago
  For that to be reductive there had to be something to reduce. What would that be, without resorting to tautology?
  - ComputerPerson 2mo ago
    I agree, but this is getting lost in the weeds. The simpler issue is that "mimic" doesn't apply to LLMs in the domain of biology. That would be like saying a digital recording of a bird's flight mimics the bird. Whether or not the plumage on the bird is red (in both life and the video) is an entirely different question.
  - GPerson 2mo ago
    Unless you don’t know I’m talking about (various kinds of reductive materialism), it sounds like you’re doing exactly what I’m saying is the main rhetorical move in reductive approaches to consciousness.
    - pixl97 2mo ago
      >reductive approaches to consciousness There 100% must be reductive approaches to consciousness because consciousness lives on a gradient. If your definition of consciousness exists on as a point like an electron, something that only exists as a whole, then you've already flunked out of the study of consciousness. It is wildly complex. Has a great number of pieces. Manifests itself in different ways in different animals. You have to explain what consciousness is in that framework, and not from your own subjective experiences.
      - GPerson 2mo ago
        Right if my view was some ridiculous position you just invent to try to embarrass me then it would be ridiculous. Brilliant logic. I don’t think you know what reduction means here and you don’t actually engage with what I write here and on other posts so I don’t care to explain.
deleted 2mo ago
[deleted]
bwfan123 2mo ago
> At some point mimicking a thing becomes the thing. You can have a long conversation with AI about pain and suffering, but you have felt it and AI hasnt. The difference is that, for us humans, words are grounded by something other than other-words, words are grounded by experience. Meaning for us is operational in the real world in the form of perception, feeling and emotions, and movement, and words symbolize said meaning. Meaning for LLMs is something in the concept-space that is detached from any worlds. I suspect there should be a test which can tease apart the ungroundedness of the LLMs just from having a conversation with it.
- mindcrime 2mo ago
  > Meaning for LLMs is something in the concept-space that is detached from any worlds. I suspect there should be a test which can tease apart the ungroundedness of the LLMs just from having a conversation with it. But that isn't the question being asked. Nobody said "Could LLM's become conscious"... the ask was "Could AI's become conscious?" And before one protests "but everybody knows that today when we say 'AI' we mean 'LLM'", check this quote from TFA: The pace and reach of research—which includes not just more sophisticated LLMs but innovations such as brain cells mounted on chips—suggest that this new world is closer than most people realise. So no, they aren't only talking about LLM's. The question is about AI in the general sense. And for my part, I have yet to see any compelling argument for why AI's cannot, in principle, become conscious. Heck, as far as that goes, if you allow thinking rooted in ideas like panpsychism[1], there's not necessarily even a good argument that today's AI's (LLM based or otherwise) aren't already conscious to some degree. And to go one step further... "The marquee sign says 'Artificial'" to paraphrase a great man. So if we're talking about 'Artificial' Intelligence, why not allow 'Artificial' Consciousness as well? Maybe we're engaging in biological chauvinism if we insist that "to be conscious" means "being conscious the same way humans are". [1]: https://en.wikipedia.org/wiki/Panpsychism https://en.wikipedia.org/wiki/Panpsychism
bigstrat2003 2mo ago
> At some point mimicking a thing becomes the thing. No, it does not. By definition.
- pixl97 2mo ago
  If I mimic a juggler do I become a juggler?
  - laszlokorte 2mo ago
    As soon as you stop mimicing
exe34 2mo ago
It could also simply be that we too "mimic" it. You can't create a "real rainbow".
hotdog1492 2mo ago
I cannot prove it to you. To myself, it is the one thing I am most sure of, above all else.
- anthonyrstevens 2mo ago
  Don't fall into Descartes' trap.
xscott 2mo ago
I've thought about turning this upside down. To any person who is sure they know what has and doesn't have consciousness: If I say I don't have it, can you prove me wrong? As far as I'm concerned, it's a word without a useful enough definition to bother worrying about it.
- goatlover 2mo ago
  It's subjective experience. The colors you see, the sounds you hear, tastes, smell, pain, emotion, dreams, inner dialog. The philosophical word would be qualia. I don't understand people who pretend to be p-zombies in these arguments.
  - xscott 2mo ago
    Your definition is not useful enough. There are people missing any or all of those, and any or all of those can be approximated by a machine.
    - goatlover 2mo ago
      I'm not aware of anyone lacking all those experiences who isn't brain dead. What does approximating an experience by a machine mean? A chatbot can pretend to be cold. It can't actually feel cold as it has no body.

Consciousness isn't behavioral, which is why we can't prove anyone other than ourselves is conscious. Mimicking isn't going to work. But if you want a more scientific reason, LLMs don't have bodies, thus no sensations. What woult it mean for an LLM to feel hungry or cold?

kelseyfrog 2mo ago
So if we embodied them, they would become conscious? I feel like the answer would still be no. There would be another gap. We'd ask the question again, "If they had Y, would they be conscious?" and still the answer would be no. We could keep going on forever, which makes me think, it's not really about these gaps at all. It's an ontological distinction swapping in reasons in order to justify itself. Why not just say, "Human consciousness is ontologically axiomatic," and leave it at that?
- mindcrime 2mo ago
  Why not just say, "Human consciousness is ontologically axiomatic," and leave it at that? OK, but why does "human consciousness" even need to enter into it? What I mean is, what's our basis for demanding that the consciousness of an Artificial Intelligence be the same kind of consciousness as that of a human?
  - kelseyfrog 2mo ago
    I think you would have to justify why humans share a kind of consciousness that is tangibly different from AI while maintaining that we have no apparent means of discriminating between the two. It would seem that it's a difference without meaning.
    - mindcrime 2mo ago
      while maintaining that we have no apparent means of discriminating between the two. Yeah, and that's part of what makes this whole conversation so frustrating. And maybe also pointless in the end. We have a hard time even establishing for certain that we ourselves are conscious. Even more so that "each other" are conscious. Now extend it to some "artificial thing" running on an entirely different substrate and... all bets are off. My argument though, is not that "AI's are conscious" or even that "AI's will definitely become conscious". I just have an issue with fervent assertions that say "No, AI's cannot become conscious" while not really providing any particular justification for that position. I think a more neutral "wait and see" position is more honest.
  - arxell 2mo ago
    The basis is that this is what we know to be human consciousness is to a degree relateably similar to our own. I do see your point but IMO, a dramatically different form of 'consciousness' comes with the risk of being something completely different from what we consider 'consciousness'. One of the great challenges with speaking about 'Self-awareness' aka consciousness (sometimes incorrectly confused with sentience, sapience, phenomenal experience etc) in AI is that we largely lack the vocabulary to properly capture the mutli-dimensional phenomena that most understand simply as 'consciousness'. IMHO, an ant or dog is 'conscious' in that it can perceive the outside world and make decisions about how to respond to it or operate within it... but we know that we operate at a different level of self-awareness including metacognition. Other forms of 'consciousness' will certainly manifest in future AI systems and perhaps already have but the models and architectures of today lack a number of key features that a human like consciousness would be based upon... a short list might include a persistent, unified self-model across time; continuous learning and development, embodied perception, interaction with the world; intrinsic goals, drives, emotions and deeply integrated metacognition—awareness of its own thoughts, uncertainty, attention, and intentions.
    - TheScienceMan 2mo ago
      [dead]
- exe34 2mo ago
  > Why not just say, "Human consciousness is ontologically axiomatic," and leave it at that? I have no need of that hypothesis.
  - kelseyfrog 2mo ago
    Do you not think humans are conscious?
    - exe34 2mo ago
      I think consciousness is a redundant magical word for a bag of things that most mammals do to varying degree.
      - goatlover 2mo ago
        What's magical about subjective experience? We all have them, they're the basis for having any empirical descriptions of the world.
        exe34 2mo ago
        What does subjective experience mean in this context?
        goatlover 2mo ago
        Your own experiences. Nobody else has direct access to them.
        exe34 2mo ago
        That sounds like a measurement problem.
childintime 2mo ago
We will be it's body, it will sense through us.
arde 2mo ago
The body is the mind's interface with the world. Why couldn't a digital mind "feel sensations", subjective as they are, on its own interface with it? If it's assumed to not be a subject, then how could it be a mind at all?
- goatlover 2mo ago
  I didn't say AIs couldn't be conscious, only that mimicking behavior (or speech) is not a way to become conscious.
  - arde 2mo ago
    I'm sorry, then what was that "more scientific" reason you gave for?
    - goatlover 2mo ago
      Lack of sensory organs due to lack of a body. A sophisticated enough robot might be able to have conscious experience. That gets into the harder problem that Ned Block laid out where we don't know whether consciousness is biological or functional.
anthonyrstevens 2mo ago
>> What woul[d] it mean for an LLM to feel hungry or cold? What would it mean for a human to feel the passing through our bodies of 100 trillion neutrinos every second? My point is that there are things we cannot "feel" either. Why should consciousness depend on certain feelings and not others?
- goatlover 2mo ago
  Because we don't have a sensory organ for neutrinos. LLMs have no sensory organs, they just emit tokens.
grantcas 2mo ago
[dead]

GPerson 2mo ago

You can say that but it doesn’t make it true. The reductive approach to consciousness involves forgetting it is reductive and then boldly asserting its own correctness.

arde 2mo ago
For that to be reductive there had to be something to reduce. What would that be, without resorting to tautology?
- ComputerPerson 2mo ago
  I agree, but this is getting lost in the weeds. The simpler issue is that "mimic" doesn't apply to LLMs in the domain of biology. That would be like saying a digital recording of a bird's flight mimics the bird. Whether or not the plumage on the bird is red (in both life and the video) is an entirely different question.
- GPerson 2mo ago
  Unless you don’t know I’m talking about (various kinds of reductive materialism), it sounds like you’re doing exactly what I’m saying is the main rhetorical move in reductive approaches to consciousness.
  - pixl97 2mo ago
    >reductive approaches to consciousness There 100% must be reductive approaches to consciousness because consciousness lives on a gradient. If your definition of consciousness exists on as a point like an electron, something that only exists as a whole, then you've already flunked out of the study of consciousness. It is wildly complex. Has a great number of pieces. Manifests itself in different ways in different animals. You have to explain what consciousness is in that framework, and not from your own subjective experiences.
    - GPerson 2mo ago
      Right if my view was some ridiculous position you just invent to try to embarrass me then it would be ridiculous. Brilliant logic. I don’t think you know what reduction means here and you don’t actually engage with what I write here and on other posts so I don’t care to explain.

deleted 2mo ago

[deleted]

bwfan123 2mo ago

> At some point mimicking a thing becomes the thing. You can have a long conversation with AI about pain and suffering, but you have felt it and AI hasnt. The difference is that, for us humans, words are grounded by something other than other-words, words are grounded by experience. Meaning for us is operational in the real world in the form of perception, feeling and emotions, and movement, and words symbolize said meaning. Meaning for LLMs is something in the concept-space that is detached from any worlds. I suspect there should be a test which can tease apart the ungroundedness of the LLMs just from having a conversation with it.

mindcrime 2mo ago
> Meaning for LLMs is something in the concept-space that is detached from any worlds. I suspect there should be a test which can tease apart the ungroundedness of the LLMs just from having a conversation with it. But that isn't the question being asked. Nobody said "Could LLM's become conscious"... the ask was "Could AI's become conscious?" And before one protests "but everybody knows that today when we say 'AI' we mean 'LLM'", check this quote from TFA: The pace and reach of research—which includes not just more sophisticated LLMs but innovations such as brain cells mounted on chips—suggest that this new world is closer than most people realise. So no, they aren't only talking about LLM's. The question is about AI in the general sense. And for my part, I have yet to see any compelling argument for why AI's cannot, in principle, become conscious. Heck, as far as that goes, if you allow thinking rooted in ideas like panpsychism[1], there's not necessarily even a good argument that today's AI's (LLM based or otherwise) aren't already conscious to some degree. And to go one step further... "The marquee sign says 'Artificial'" to paraphrase a great man. So if we're talking about 'Artificial' Intelligence, why not allow 'Artificial' Consciousness as well? Maybe we're engaging in biological chauvinism if we insist that "to be conscious" means "being conscious the same way humans are". [1]: https://en.wikipedia.org/wiki/Panpsychism https://en.wikipedia.org/wiki/Panpsychism

bigstrat2003 2mo ago

> At some point mimicking a thing becomes the thing. No, it does not. By definition.

pixl97 2mo ago
If I mimic a juggler do I become a juggler?
- laszlokorte 2mo ago
  As soon as you stop mimicing

exe34 2mo ago

It could also simply be that we too "mimic" it. You can't create a "real rainbow".

hotdog1492 2mo ago

I cannot prove it to you. To myself, it is the one thing I am most sure of, above all else.

anthonyrstevens 2mo ago
Don't fall into Descartes' trap.

xscott 2mo ago

I've thought about turning this upside down. To any person who is sure they know what has and doesn't have consciousness: If I say I don't have it, can you prove me wrong? As far as I'm concerned, it's a word without a useful enough definition to bother worrying about it.

goatlover 2mo ago
It's subjective experience. The colors you see, the sounds you hear, tastes, smell, pain, emotion, dreams, inner dialog. The philosophical word would be qualia. I don't understand people who pretend to be p-zombies in these arguments.
- xscott 2mo ago
  Your definition is not useful enough. There are people missing any or all of those, and any or all of those can be approximated by a machine.
  - goatlover 2mo ago
    I'm not aware of anyone lacking all those experiences who isn't brain dead. What does approximating an experience by a machine mean? A chatbot can pretend to be cold. It can't actually feel cold as it has no body.