3 ms·
I think Searle is even more relevant today, with GPT-3. It's getting really hard to distinguish a GPT-3 text from actual human generated text. But we also kno
by jimbokun 6y ago
I think Searle is even more relevant today, with GPT-3.
It's getting really hard to distinguish a GPT-3 text from actual human generated text.
But we also know how GPT-3 generates those texts is absolutely nothing like how a human generates a text. GPT-3 seems more like the man in the Chinese Room, in how it writes, than a human being.
Or is it? Are we really just a deep neural network implemented in meat?
Or is there something fundamentally different between how we experience the world, and how GPT-3 experiences the world?
- pdonis 6y ago> It's getting really hard to distinguish a GPT-3 text from actual human generated text. No, it isn't. What is getting really hard is to distinguish a GPT-3 text from actual human generated text without any context. Plop GPT-3 down in a room full of humans having a conversation (or, under current conditions, put it in a Zoom call with humans having a conversation) and ask it to generate text as if it were another human participating in the conversation, and it will quickly become obvious that it is not a human, since it will fail miserably. The text it generates will be "human-like", but will have no relationship with what the humans are talking about.
- Ajedi32 6y agohttps://mc.ai/a-chat-with-gpt-3/ https://mc.ai/a-chat-with-gpt-3/ Certainly not good enough to pass as human, but I'm not sure "failed miserably" is a fair description either.
- pdonis 6y ago> I'm not sure "failed miserably" is a fair description either. Interesting, thanks for the link! Particularly towards the end, this looks similar to transcripts of conversations with ELIZA. I suppose "failed miserably" is indeed an overstatement, given that comparison, since ELIZA, IIRC, actually did fool some psychologists into thinking it was an actual paranoid human being.
- canjobear 6y agoGive it 2 or 3 years.
- magusdei 6y agoI've actually done this experiment by putting a GPT-3 bot in a Telegram group. Its replies were mostly stuck in an uncanny valley where they sort of made sense, but often either lacked detail or seemed to very slightly misunderstand what the topic of discussion was. This might have been just because I didn't include enough context in the prompt, however. I have some plans for improving the prompting strategy, so we'll see. I actually recently wrote a post on the topic of whether GPT-3 can be said to understand anything[1]. The argument is a bit too long to summarize here, but I don't think what GPT-3 is doing is as fundamentally different from what human brains do as people seem to think. [1] https://magusdei.com/why-gpt3-can-understand-things.html https://magusdei.com/why-gpt3-can-understand-things.html
- sjy 6y agoThe fundamental difference is that GPT-3 can only read text. Humans can see, hear, feel, taste, move, and socialise. Both systems learn by ingesting data, but human brains get a lot more input of a much wider variety over a much longer time.
- nobody9999 6y ago>Or is there something fundamentally different between how we experience the world, and how GPT-3 experiences the world? Jump in the shower and wash your hair. Then come back and answer your own question.