7 ms·
The argument this relates to - will machines be able to think - seems to have died out rather. Back in the day people worried about things like John Searle's C
by tim333 6y ago
The argument this relates to - will machines be able to think - seems to have died out rather. Back in the day people worried about things like John Searle's Chinese Room argument as a philosophical proof that computers wouldn't be able to understand stuff. I always thought the Chinese Room thing was a bit silly and the Meat story a good rebuttal.
I guess these days computers have advanced enough that the worry is more will Facebook's AI use it's understanding of us in bad ways rather than will machines be able to understand.
- dekhn 6y agoPeople stopped paying attention to Searle when he was asked how he could tell his dog was conscious, and he replied "I can see it in his eyes".
- baggy_trough 6y agoSearle is a wise man.
- jimbokun 6y agoDo you have a better answer?
- dekhn 6y agoWell, it seems to sort of kill his argument because he's saying you can detect consciousness via a visible tell, but a sufficiently advanced dog-robot with expressive eyes would trick him (there's a reason I work in machine learning)
- 6510 6y agono no, the sufficiently advanced dog would be conscious by his definition.
- dekhn 6y agoerr, no? The sufficiently advanced dog would be able to fool a human into thinking it was a real dog, but at least according to Searle: """The Chinese room argument holds that a digital computer executing a program cannot be shown to have a "mind", "understanding" or "consciousness",[a] regardless of how intelligently or human-like the program may make the computer behave""" He undermines his whole argument by implying he can tell his dog is conscious simply by visualizing its eyes.
- ifdefdebug 6y agoYour argument is based on the proposition that a dog machine able to fool him can be built. There is no proof for that yet, and having it for an axiom is quite far fetched.
- sjy 6y agoIsn’t Searle’s argument based on the equally far-fetched axiom that a program could be written which (a) passes the Turing test, and (b) could be executed by a human using pencil and paper, with sufficient speed to not fail the Turing test?
- ifdefdebug 6y agoNo, obviously not because that's just absurd. But one could ask if the fact of a human with pencil and paper being dead slow computing the output is enough to invalidate the whole argument. But anyway, I am not trying to defend Searle’s argument. I was just pointing out something what seemed to me like a flaw in that particular refutation.
- 6510 6y agoI started writing and didn't finish a chat bot one time that meats the criteria. (Actually 2 chat bots) The formula is this: 1) The 2 bots have a scripted conversation. 2) When a human tries to participate (read: interrupts) they have a conversation like "Bot1: who is this guy? Do you know him? Bot2: NO". Then they happily continue their chat completely ignoring the human unless he types their username. Then it goes "What do you want?" and "Could you please stop highlighting me" etc
- meowface 6y ago"I know it when I see it."
- hnracer 6y agoIt's not so absurd. How do we know solipsism isn't true? Because of two reasons, (1) the physiology of others is similar to our physiology, and (2) we can see evidence of inner state reflected in behaviour. For dogs we can make a similar argument using (1) and (2). It is slightly weaker than applying it to other humans but not by much. Searle's comment pertains to (2).
- gdy 6y agoWhich people?
- TaupeRanger 6y agoAnd they shouldn't have. That's a perfectly reasonable argument: an organism's behavior (movement of the eyes and facial gestures) give clues about its internal state and potential conscious experiences.
- rvense 6y agoAs a linguist (well, person with a degree in linguistics), I think Searle makes a very strong point, and I don't think it's at all fair to call it rebutted or disproven. The core part of the room is a book where the operator looks up symbols coming in and is able to mindlessly copy the answer to the output. Such a book (or whatever book-like device, i.e. a list of inputs with corresponding outputs) that allows a person to interact with someone in a language they don't speak is an absurdity, it cannot exist. Human language in use does not work like that. But the notion is not far from the bone-headed simplicity of early AI and machine translation efforts.
- dragonwriter 6y ago> As a linguist (well, person with a degree in linguistics), I think Searle makes a very strong point, and I don't think it's at all fair to call it rebutted or disproven. I think you are about to disprove this point. > The core part of the room is a book where the operator looks up symbols coming in and is able to mindlessly copy the answer to the output. Such a book (or whatever book-like device, i.e. a list of inputs with corresponding outputs) that allows a person to interact with someone in a language they don't speak is an absurdity, it cannot exist. Yup, that's both true and a pretty convincing rebuttal of the Chinese Room. > But the notion is not far from the bone-headed simplicity of early AI and machine translation efforts. So, what? No one, anywhere claimed that those early efforts were self-aware or had understanding, nor are they what the Chinese Room is even notionally directed at: it was directed at the limit of possibility, not the then-current implementations.
- rvense 6y agoI honestly don't understand how that's a rebuttal of the Chinese room. Obviously a person with such a fantastic device would not "understand Chinese" if they had it.
- dragonwriter 6y agoThe Chinese Room is an argument that a Turing-like test is inadequate to prove understanding of a language because a combination of two things, neither of which have understanding, could conceivably pass it for every test scenario. The fact that one of those two things is impossible (or, alternatively, is equivalent to a device encoding a full understanding of the language) negates the argument.
- jimbokun 6y agoI think Searle is even more relevant today, with GPT-3. It's getting really hard to distinguish a GPT-3 text from actual human generated text. But we also know how GPT-3 generates those texts is absolutely nothing like how a human generates a text. GPT-3 seems more like the man in the Chinese Room, in how it writes, than a human being. Or is it? Are we really just a deep neural network implemented in meat? Or is there something fundamentally different between how we experience the world, and how GPT-3 experiences the world?
- pdonis 6y ago> It's getting really hard to distinguish a GPT-3 text from actual human generated text. No, it isn't. What is getting really hard is to distinguish a GPT-3 text from actual human generated text without any context. Plop GPT-3 down in a room full of humans having a conversation (or, under current conditions, put it in a Zoom call with humans having a conversation) and ask it to generate text as if it were another human participating in the conversation, and it will quickly become obvious that it is not a human, since it will fail miserably. The text it generates will be "human-like", but will have no relationship with what the humans are talking about.
- Ajedi32 6y agohttps://mc.ai/a-chat-with-gpt-3/ https://mc.ai/a-chat-with-gpt-3/ Certainly not good enough to pass as human, but I'm not sure "failed miserably" is a fair description either.
- pdonis 6y ago> I'm not sure "failed miserably" is a fair description either. Interesting, thanks for the link! Particularly towards the end, this looks similar to transcripts of conversations with ELIZA. I suppose "failed miserably" is indeed an overstatement, given that comparison, since ELIZA, IIRC, actually did fool some psychologists into thinking it was an actual paranoid human being.
- canjobear 6y ago
- Igelau 6y agoIs this about that? I always thought it was more an exercise in pointing out that other life in the universe may not be recognizable as such. It's hard to imagine such a thing directly, but the story gets us to the border of it by flipping the tables and presenting Earth Life as unbelievable to an undefined alien POV.
- tim333 6y agoNot that sure to be honest. Maybe that was just my interpretation.
- aj7 6y agoHey Siri, find John Searles Chinese Room argument.
- Terr_ 6y ago> I always thought the Chinese Room thing was a bit silly For your amusement, in that Turing-test-ish vein: https://existentialcomics.com/comic/357 https://existentialcomics.com/comic/357