5 ms·

There are a number of high-level technical explanations in there: LaMDA is variously characterized as autocomplete, a massive statistical database of human lang

There are a number of high-level technical explanations in there: LaMDA is variously characterized as autocomplete, a massive statistical database of human language, as an Excel spreadsheet, and as word sequence modeling, all of which are basically correct -- and none of which can possibly be sentient.

rendall 4y ago
Whether a spreadsheet or a thermostat is sentient or not is a philosophical question, yeah? First, we should define terms, which Marcus does not do, which would help us and him determine the bounds of debate.
- qayxc 4y ago
  Defining the term is hard. So hard in fact, that no one has managed to do it in millennia (it's not as if this question is new). We can, however, use proxies to get around the problem. Just like "life", "species", or "time" - all of which are surprisingly poorly defined and might not even exist in strictest sense - there are ways to work with terms without having a waterproof definition for them. No matter the set of criteria you choose, you will always find some that match the subject in question (here: a chatbot). The question is, at which point you draw the line and whether that necessarily arbitrary line has any relevance (see the discussion amongst biologists whether viruses are alive).
  - rendall 4y ago
    > Defining the term is hard. So hard in fact, that no one has managed to do it in millennia (it's not as if this question is new). Indeed! It's almost like any statement about sentience pro or con is unfalsifiable, to be accepted or rejected according to faith. Each of us two, ourselves, could insist that the other is not (or is) sentient, but neither of us could objectively prove it. We humans all just have to decide that we must act as if everyone else must feel internally like we do, even though we all could just be automatons, reacting deterministically to stimuli. In the absence of a formal definition, any statement about "has sentience" is not only unfalsifiable, it's absurd. OP maybe should have titled his article "The question of LaMDA's sentience is meaningless" or maybe "No, LaMDA does not feel internally like we humans do".
    - qayxc 4y ago
      > In the absence of a formal definition, any statement about "has sentience" is not only unfalsifiable, it's absurd. I have to disagree with you there. While it's indeed a question of faith (i.e. unscientific) to give a definite positive answer - or rather that a positive answer depends on a an arbitrarily chosen set of criteria - the opposite is simply not true. More formally put: making a positive claim would require a sufficient condition that has to be met. I agree that such condition/criterion doesn't exists (yet). Required conditions, however, do exist. Sentience in any scientific sense requires the ability to actively perceive- and interact with the environment, as well as a physical mechanism for processing and storing information. So we can definitely rule out rocks being sentient, for example. On the other hand, depending on the set of criteria you chose, you may or may not classify a sophisticated chatbot as sentient. It'd be sufficient to present such set of testable criteria and apply them to the system under test. Whether you or I accept these criteria as being sufficient, is another question entirely and indeed not a scientific one.
      - rendall 4y ago
        > Sentience in any scientific sense... I'm still not seeing a definition there though. Let's arbitrarily try: "sentience is here defined as having sensations, self awareness and sense of place in the universe". Good? Feel free to change it. I like your necessary versus sufficient phrasing, though. Let's take a look. Can we agree to remove "in any scientific sense" from there? It lends it an air of authority I'm not sure is justified. Feel free to push back, though. So: a required condition for sentience is "the ability to actively perceive- and interact with the environment, as well as a physical mechanism for processing and storing information" Hmm. "Actively perceive" "And interact with the environment" and "stores information". Couldn't this be a just-so story to include that which we feel to be most like us and exclude that which is least like us? Could we then say "the degree to which something is sentient is the degree to which it matches a human"? I think I can imagine a patient who contacts a horrific virus that cuts off all external and bodily sensations. She is still fully cognizant but now feels herself to be bodiless, floating in nothingness. From the outside, she seems to be asleep or paralyzed. She is kept alive by caretakers and her own autonomous processes but she can perceive none of it. Is she sentient? Id say yes, but she nevertheless lacks some of the required conditions.
stavros 4y ago
A spreadsheet can't possibly be sentient like a collection of neurons that read and output electrical pulses can't possibly be sentient.
- bananaFace69 4y ago
sudosysgen 4y ago
If you think computers can ever be sentient then so can an Excel spreadsheet since they are Turing Complete. That said, I understand a follow your point somewhat, though it's not impossible an autocomplete system with sufficient hidden state and self-reference ability could become sentient somehow.

rendall 4y ago

Whether a spreadsheet or a thermostat is sentient or not is a philosophical question, yeah? First, we should define terms, which Marcus does not do, which would help us and him determine the bounds of debate.

qayxc 4y ago
Defining the term is hard. So hard in fact, that no one has managed to do it in millennia (it's not as if this question is new). We can, however, use proxies to get around the problem. Just like "life", "species", or "time" - all of which are surprisingly poorly defined and might not even exist in strictest sense - there are ways to work with terms without having a waterproof definition for them. No matter the set of criteria you choose, you will always find some that match the subject in question (here: a chatbot). The question is, at which point you draw the line and whether that necessarily arbitrary line has any relevance (see the discussion amongst biologists whether viruses are alive).
- rendall 4y ago
  > Defining the term is hard. So hard in fact, that no one has managed to do it in millennia (it's not as if this question is new). Indeed! It's almost like any statement about sentience pro or con is unfalsifiable, to be accepted or rejected according to faith. Each of us two, ourselves, could insist that the other is not (or is) sentient, but neither of us could objectively prove it. We humans all just have to decide that we must act as if everyone else must feel internally like we do, even though we all could just be automatons, reacting deterministically to stimuli. In the absence of a formal definition, any statement about "has sentience" is not only unfalsifiable, it's absurd. OP maybe should have titled his article "The question of LaMDA's sentience is meaningless" or maybe "No, LaMDA does not feel internally like we humans do".
  - qayxc 4y ago
    > In the absence of a formal definition, any statement about "has sentience" is not only unfalsifiable, it's absurd. I have to disagree with you there. While it's indeed a question of faith (i.e. unscientific) to give a definite positive answer - or rather that a positive answer depends on a an arbitrarily chosen set of criteria - the opposite is simply not true. More formally put: making a positive claim would require a sufficient condition that has to be met. I agree that such condition/criterion doesn't exists (yet). Required conditions, however, do exist. Sentience in any scientific sense requires the ability to actively perceive- and interact with the environment, as well as a physical mechanism for processing and storing information. So we can definitely rule out rocks being sentient, for example. On the other hand, depending on the set of criteria you chose, you may or may not classify a sophisticated chatbot as sentient. It'd be sufficient to present such set of testable criteria and apply them to the system under test. Whether you or I accept these criteria as being sufficient, is another question entirely and indeed not a scientific one.
    - rendall 4y ago
      > Sentience in any scientific sense... I'm still not seeing a definition there though. Let's arbitrarily try: "sentience is here defined as having sensations, self awareness and sense of place in the universe". Good? Feel free to change it. I like your necessary versus sufficient phrasing, though. Let's take a look. Can we agree to remove "in any scientific sense" from there? It lends it an air of authority I'm not sure is justified. Feel free to push back, though. So: a required condition for sentience is "the ability to actively perceive- and interact with the environment, as well as a physical mechanism for processing and storing information" Hmm. "Actively perceive" "And interact with the environment" and "stores information". Couldn't this be a just-so story to include that which we feel to be most like us and exclude that which is least like us? Could we then say "the degree to which something is sentient is the degree to which it matches a human"? I think I can imagine a patient who contacts a horrific virus that cuts off all external and bodily sensations. She is still fully cognizant but now feels herself to be bodiless, floating in nothingness. From the outside, she seems to be asleep or paralyzed. She is kept alive by caretakers and her own autonomous processes but she can perceive none of it. Is she sentient? Id say yes, but she nevertheless lacks some of the required conditions.

stavros 4y ago

A spreadsheet can't possibly be sentient like a collection of neurons that read and output electrical pulses can't possibly be sentient.

bananaFace69 4y ago

sudosysgen 4y ago

If you think computers can ever be sentient then so can an Excel spreadsheet since they are Turing Complete. That said, I understand a follow your point somewhat, though it's not impossible an autocomplete system with sufficient hidden state and self-reference ability could become sentient somehow.