4 ms·
> ChatGPT isn't sentient Perhaps, perhaps not. Although I lean towards you on this, we don't have a definition good enough to test against, so we can't tell i
by ben_w 4y ago
> ChatGPT isn't sentient
Perhaps, perhaps not.
Although I lean towards you on this, we don't have a definition good enough to test against, so we can't tell if it is or isn't.
I was recently thinking about the philosophy course I took 22 years ago; Descartes saying that every experience he ever had could be illusions or insanity, the only thing he could know was "I think therefore I am", and A. J. Ayer a few centuries later saying no, all you can say is "There is a thought now" because any memory or certainty you have of the past is also capable of being insanity.
So… how can we be sure that LLMs or image generators or any other AI don't have the feeling of an instantaneous now? That they don't have "a thought now"?
We can't rely on the fact that they will, if asked, hallucinating a story about when they were switched off: we also do that, not just with dreams when we sleep, but with our tales of reincarnation and afterlives.
- avgcorrection 4y agoPre-civilization animism like assigning will and consciousness to trees is more common-sensical compared to what you are doing.
- zmgsabst 4y agoArgument by insult isn’t appropriate. What exactly do you find “more common-sensical” about imaging a tree is conscious than something that can create English sentences describing the world?
- avgcorrection 4y agoNot so much an argument as a statement. A tree is made of living matter, like fauna. An AI is a program which runs on silicon, and I don’t think scientists have found silicone-based lifeforms on Earth.
- ben_w 4y agoThe only way that statement would be relevant is if souls existed. I don't believe in souls. To your previous comment upthread, GPT-3 is about the complexity of a rat brain. Do rats have feelings? I don't know, as we share a common ancestor it might just be an anthropomorphisation of shared mammalian reflexes that makes me think rats act like they have them. Does GPT-3? I don't know, but it's a very good actor, so I can't even infer anything from the fact it can act like it has them — after all a VHS player can also perfectly reproduce human emotional affect. Is GPT-3 more like a VHS or more like a rat? I see aspects of both in it. I don't see a way to more than guess at which aspect makes a difference. A rat brain has to keep doing rat things to stay alive, but GPT-3 can use the same parameter space to instead communicate in Spanish and Mandarin, to answer physics questions and write poetry and Python. The "staying alive" process might, or might not, have anything to do with conciseness, but even if consciousness in vivo is about the process of staying alive, there is no obvious reason to think the process/structure cannot be replicated in-silico. Trees can't do any of those things that LLMs and diffusion models can do.
- YeGoblynQueenne 4y ago>> The only way that statement would be relevant is if souls existed. I think the OP is saying that carbon is not like silicon and perhaps carbon is special in a way that silicon isn't. They're not saying that humans are special because they have souls, or something along those lines.
- avgcorrection 4y agoYep, pretty much.
- jimmygrapes 4y ago>I don't believe in souls. Why not? I mean I could presume a lot on your behalf, like how the concept is non-falsifiable, lack of evidence that can be replicated, past trauma from people you trusted who insisted upon it but then behaved hypocritically, etc. but every time someone says they don't believe in souls I can't help but ask why not. You don't have to answer but I'm always interested to hear what others say. Disclaimer: I personally believe in something akin to souls, not individualized, and it's hard to explain my ideas so I like to hear what others think before I say what I think.
- zmgsabst 4y agoWhat makes it “common sense” that being made of cells makes you conscious but being able to learn and speak does not?
- avgcorrection 4y agoThe made of cells thing is an old superstition that merely makes relatively more sense[1] than this modern techy superstition: A human is living matter, is conscious, so why not trees aswell The techy superstition, however, involves people looking at AI programs, acknowledging that we know how they work, and then for some odd reason want to insist that they could now or at some point gain the emergent property of consciousness. Based on what? Well because they “learn”. And “speak”. What are these two words? Metaphors based on what humans do. So some computer programs can do things that we metaphorically compare to our own skills. And that imbues them with consciousness? How? At this point you get the response that all theists insist upon in the end, when it all comes down to it: Why not? Incredulity, in other words. Why not God? Why not a ghost in the machine? Can you disprove that there is a ghost in the machine? [1] Not in an absolute sense
- karpierz 4y ago> Although I lean towards you on this, we don't have a definition good enough to test against, so we can't tell if it is or isn't. I don't think a definition of consciousness is possible in any objective sense, as consciousness is by definition, a subjective experience. A more useful question is why ask if LLMs are conscious? ex: 1. Are you trying to decide whether shutting them off is ethical? 2. Are you trying to figure out how to manipulate them to ask your questions correctly? 3. Are you trying to answer whether they can replicate anything a human can do? When the contextual question that prompts the word "consciousness" is defined, we can make progress in determining whether something is "conscious". For example, if it's a question of ethics, then you follow up by defining your ethical framework.
- eternityforest 4y agoI think the ethical question is the only one that really requires even discussing consciousness. Unless there are externally observable things that can't or are unlikely to be done without consciousness, which doesn't seem to be a solved question either.
- onethought 4y agoBut even the ethical question is straight forward. LLM definitely don’t suffer, and we are happy “shutting off” a dog which both can suffer and has some greater level of consciousness. So, yes, it’s fine to shut off LLMs
- ben_w 4y agoSociety may be happy doing that to a dog, I am not. Nor am I happy doing that to animals which are turned into dog meat. Contradictions abound with more than a superficial glance on many moral topics, in part due to our lack of any of omniscience, omnipotence, nor omnibenevolence.
- onethought 4y agoBut we aren’t talking about you. We are talking about us, society. And it’s unequivocal.
- kgwgk 4y ago> how can we be sure that LLMs or image generators or any other AI don't have the feeling of an instantaneous now I don’t think I had seen anyone yet suggesting that image generators could have feelings.
- ben_w 4y agoNeither have I, but why would one be different from the other?
- kgwgk 4y agoIt isn't.
- wizofaus 4y agoThat's a pretty good observation though - it's only because ChatGPT spits out language that appears to convey some of the sorts of thought patterns that humans have that we're even having this discussion, but is it even relevant? I would think a chimpanzee or a dolphin (or a human with the inability to use language for some reason) would far more obviously qualify as sentient than a LLM. And as you say, a similar computational model that generates images or music instead doesn't even provoke the debate about possible sentience. Personally I don't think there's any doubt at this point - ChatGPT itself constantly reminds you in no uncertain terms that it's "just a language model". I've never seen it display anything remotely like emotion, hope/desires, seen it attempt to plead or engage with you in any sort of way. It can't initiate anything (unprompted, it will never just bring up something to talk about), it shows no curiosity, fails to appreciate or recognise humour, never seems to show uncertainty, and frankly has no "personality" (at best there are a few particular turns of phrase it tends to use that I might associate with it, but compared to the 100s of cases where I've got to know actual humans purely through online text-based interactions, there's really no comparison). Once we start to see those sorts of clear indicators of human-like sentience (probably sooner than we expect!) then it's worth revisiting the discussion.
- kubanczyk 4y ago> we don't have a definition Don't worry, these goalposts are not meant to stay in place for too long.
- mcswell 4y ago"> ChatGPT isn't sentient Perhaps, perhaps not." I'm pretty sure it's not, but I have to admit that it does a reasonable job in many situations of passing a Turing test. (Not all, it fails for example at counting.) My guess is that if Alan Turing interacted with one, he'd conclude that he needed to go back to the drawing board on his test for sentience.