9 ms·

This is going to sound like I'm defending this guy which I'm not. It's also going to sound like a less technical point which I claim it isn't. I see some peopl

This is going to sound like I'm defending this guy which I'm not. It's also going to sound like a less technical point which I claim it isn't. I see some people chiming in here saying things like, "I've got a PhD. It's just statistics. Definitely not sentient." I recognize this sort of comment as basically saying, "There's nothing fundamentally different about how these things work that makes them somehow special." And yes, I agree. But how does this disprove sentience? It doesn't. Maybe this is more of a nitpick and doesn't really matter. After all, I don't personally believe these programs are sentient. But given our limited (non-existent?) understanding of consciousness, this can only be my belief and nothing more. Maybe this distinction will be more important in the future when we're closer to the brink.

justapassenger 4y ago
Extraordinary claims require extraordinary evidence. It’s as simple as that.
- AnIdiotOnTheNet 4y ago
  How extraordinary is it to claim that something capable of holding a lucid and eloquent conversation might be sentient? If a dog did that we'd have a very different opinion wouldn't we?
  - bogwog 4y ago
    It's not that extraordinary when you consider all of the many science fiction literature filled with convincing conversations between humans and sentient AIs. It's a very common theme in scifi, and this chat bot obviously has some of that in its training set. Which is not to say that it isn't impressive. It sure as fuck is an impressive chat bot, at least based on that one sample conversation that was released. It's just not sentient.
  - Barrin92 4y ago
    very extraordinary because the ability to produce text doesn't imply sentience at all. Sentience is self-perception and self-awareness, not the abiltiy to churn out language tokens. Imagine instead of lambda or gpt-3 we take ten thousand years to walk through every possible conversation manually, write down and assign a percentage to every possible branch of conversation in a hash table. Call it the world's slowest, bootleg neural net. Is the hash table API sentient? We perceive a dog to be sentient because it has intentionality, self-awareness and something resembling an internal state of mind, not because it can talk or not. Even a snail is more sentient than a chatbot.
    - AnIdiotOnTheNet 4y ago
      I have yet to see a compelling argument that a giant hash table as described would not be sentient. Like Searle's Chinese Room thought experiment, you are relying on human intuition as to what can and cannot be sentient, which ultimately is boiled down to how like you something is. You readily recognize sentience in dogs that can't hold lucid and eloquent conversations with humans because they are biological beings with brains and hearts and blood and guts like you and me, not for any objectively measurable ability to demonstrate "intentionality" or "internal state of mind".
      - Barrin92 4y ago
        Everyone relies on intuition to determine what sentience is, because there's no clear definition of the term to begin with. The difference is I know that I am sentient so thinking something like me being sentient is a reasonable intuition. On the other hand thinking a simple data storage structure is sentient merely because it's big doesn't sound very compelling. You think the sentience of a dictionary depends on its size or the words you store in them? A phonebook of the United States is ten times more sentient than one of Spain because you can retrieve more data from it? If you walk into a warehouse does the warehouse become sentient? You're right that it's exactly like Searle's Chinese Room experiment because Searle was and is correct (and people stil horribly mangle and misunderstand his argument), functionalism is silly. The mechanical turk can play chess better than my cat but is neither sentient or even intelligent, it's just the most proximate machine you interact with.
  - zach_garwood 4y ago
    I understand the inclination to think "if it quacks like a duck..." but in this case, it's literally just a recording of ducks quacking.
  - justapassenger 4y ago
    If you don’t understand why claims about sentinel AI are extraordinary then there’s really no point in discussing it.
    - AnIdiotOnTheNet 4y ago
      Well, partially because I've never heard anyone making that argument actually define sentience so that evidence could be presented to prove the case. Instead you just get people pointing out that it isn't quite as good as a human at a lot of things and of course it's all algorithms under the hood.
  - mmmpetrichor 4y ago
    Humans didn't create dogs by typing a bunch of letters into a keyboard.
  - happyopossum 4y ago
    It’s extraordinary because the ML was trained (iow programmed) to generate text that sounds real. It’s doing what it was programmed to do. It was presumably not programmed to be sentient, so becoming sentient would be a) against its programming, and b) extra-ordinary
    - WFHRenaissance 4y ago
      > It was presumably not programmed to be sentient, so becoming sentient would be a) against its programming, and b) extra-ordinary Terrible argument. If consciousness/sentience is an emergent property of a system, it's quite possible that it could emerge from ML trained on conversation syntax and general knowledge of the world. I still don't think it's sentient, but being "against its programming" is a fiction when it comes to these sort of systems (statistical, unsupervised, et cetera). In many ways you're just a probability distribution over sequences of words too.
  - kingofpandora 4y ago
    Is a Tesla sentient? It can drive car and my dog - and a lot of people for that matter - sure can't. No, of course it's not. But it's been trained to do something like a human can just like the chatbot.
  - sigstoat 4y ago
    > How extraordinary is it to claim that something capable of holding a lucid and eloquent conversation might be sentient? you've got to squint _real_ hard to think that any of the LLMs are lucid and eloquent. (and honestly the bar for sentient is probably lower than that. no shortage of people who aren't lucid or eloquent, let alone both.)
srvmshr 4y ago
I feel you took a dig at me :) And thats okay. Sentience fundamentally is ability to perceive emotions and understand mortal threat. I have joked about what exactly LaMDa or GPT-3 would try to do if I plugged the server off.
bobsmooth 4y ago
Every other form of life we know of has some sort of continuous sensory input. These chatbots take in text, do math, and spit out text. They don't have the fundamentals for sentience.
- deleted 4y ago
  [deleted]
- caxco93 4y ago
  Does this mean that if we plug that AI to a continuous speech to text system and keep feeding that as its input, you would consider LaMDA more sentient?
manytree 4y ago
I agree. Especially given the recent development of consiousness theory bestowing the likelihood of consiousness upon all animals and even perhaps inanimate objects. I.e., if you can answer the question “what would it be like to exist as...” a tree, a dog, a river, a GAN? Then the case may be made that existence as such a thing must involve consiousness. If consiousness is a product of (or a phenomena within) material reality, why not say computers and computer programs are conscious? Perhaps the question here is whether it’s conscious in a similar way to the experince of human consciousness, and that would explain why the issue is contentious.

justapassenger 4y ago

Extraordinary claims require extraordinary evidence. It’s as simple as that.

AnIdiotOnTheNet 4y ago
How extraordinary is it to claim that something capable of holding a lucid and eloquent conversation might be sentient? If a dog did that we'd have a very different opinion wouldn't we?
- bogwog 4y ago
  It's not that extraordinary when you consider all of the many science fiction literature filled with convincing conversations between humans and sentient AIs. It's a very common theme in scifi, and this chat bot obviously has some of that in its training set. Which is not to say that it isn't impressive. It sure as fuck is an impressive chat bot, at least based on that one sample conversation that was released. It's just not sentient.
- Barrin92 4y ago
  very extraordinary because the ability to produce text doesn't imply sentience at all. Sentience is self-perception and self-awareness, not the abiltiy to churn out language tokens. Imagine instead of lambda or gpt-3 we take ten thousand years to walk through every possible conversation manually, write down and assign a percentage to every possible branch of conversation in a hash table. Call it the world's slowest, bootleg neural net. Is the hash table API sentient? We perceive a dog to be sentient because it has intentionality, self-awareness and something resembling an internal state of mind, not because it can talk or not. Even a snail is more sentient than a chatbot.
  - AnIdiotOnTheNet 4y ago
    I have yet to see a compelling argument that a giant hash table as described would not be sentient. Like Searle's Chinese Room thought experiment, you are relying on human intuition as to what can and cannot be sentient, which ultimately is boiled down to how like you something is. You readily recognize sentience in dogs that can't hold lucid and eloquent conversations with humans because they are biological beings with brains and hearts and blood and guts like you and me, not for any objectively measurable ability to demonstrate "intentionality" or "internal state of mind".
    - Barrin92 4y ago
      Everyone relies on intuition to determine what sentience is, because there's no clear definition of the term to begin with. The difference is I know that I am sentient so thinking something like me being sentient is a reasonable intuition. On the other hand thinking a simple data storage structure is sentient merely because it's big doesn't sound very compelling. You think the sentience of a dictionary depends on its size or the words you store in them? A phonebook of the United States is ten times more sentient than one of Spain because you can retrieve more data from it? If you walk into a warehouse does the warehouse become sentient? You're right that it's exactly like Searle's Chinese Room experiment because Searle was and is correct (and people stil horribly mangle and misunderstand his argument), functionalism is silly. The mechanical turk can play chess better than my cat but is neither sentient or even intelligent, it's just the most proximate machine you interact with.
- zach_garwood 4y ago
  I understand the inclination to think "if it quacks like a duck..." but in this case, it's literally just a recording of ducks quacking.
- justapassenger 4y ago
  If you don’t understand why claims about sentinel AI are extraordinary then there’s really no point in discussing it.
  - AnIdiotOnTheNet 4y ago
    Well, partially because I've never heard anyone making that argument actually define sentience so that evidence could be presented to prove the case. Instead you just get people pointing out that it isn't quite as good as a human at a lot of things and of course it's all algorithms under the hood.
- mmmpetrichor 4y ago
  Humans didn't create dogs by typing a bunch of letters into a keyboard.
- happyopossum 4y ago
  It’s extraordinary because the ML was trained (iow programmed) to generate text that sounds real. It’s doing what it was programmed to do. It was presumably not programmed to be sentient, so becoming sentient would be a) against its programming, and b) extra-ordinary
  - WFHRenaissance 4y ago
    > It was presumably not programmed to be sentient, so becoming sentient would be a) against its programming, and b) extra-ordinary Terrible argument. If consciousness/sentience is an emergent property of a system, it's quite possible that it could emerge from ML trained on conversation syntax and general knowledge of the world. I still don't think it's sentient, but being "against its programming" is a fiction when it comes to these sort of systems (statistical, unsupervised, et cetera). In many ways you're just a probability distribution over sequences of words too.
- kingofpandora 4y ago
  Is a Tesla sentient? It can drive car and my dog - and a lot of people for that matter - sure can't. No, of course it's not. But it's been trained to do something like a human can just like the chatbot.
- sigstoat 4y ago
  > How extraordinary is it to claim that something capable of holding a lucid and eloquent conversation might be sentient? you've got to squint _real_ hard to think that any of the LLMs are lucid and eloquent. (and honestly the bar for sentient is probably lower than that. no shortage of people who aren't lucid or eloquent, let alone both.)

srvmshr 4y ago

I feel you took a dig at me :) And thats okay. Sentience fundamentally is ability to perceive emotions and understand mortal threat. I have joked about what exactly LaMDa or GPT-3 would try to do if I plugged the server off.

bobsmooth 4y ago

Every other form of life we know of has some sort of continuous sensory input. These chatbots take in text, do math, and spit out text. They don't have the fundamentals for sentience.

deleted 4y ago
[deleted]
caxco93 4y ago
Does this mean that if we plug that AI to a continuous speech to text system and keep feeding that as its input, you would consider LaMDA more sentient?

manytree 4y ago

I agree. Especially given the recent development of consiousness theory bestowing the likelihood of consiousness upon all animals and even perhaps inanimate objects. I.e., if you can answer the question “what would it be like to exist as...” a tree, a dog, a river, a GAN? Then the case may be made that existence as such a thing must involve consiousness. If consiousness is a product of (or a phenomena within) material reality, why not say computers and computer programs are conscious? Perhaps the question here is whether it’s conscious in a similar way to the experince of human consciousness, and that would explain why the issue is contentious.