7 ms·
The AI Mirror Test, which smart people keep failing
- soroushjp 4y agoVery little by way of arguments for why these chat bots are or aren't sentient. This article has an assumed point of view (current AI bots aren't sentient) and then describes & judges user's reactions to chat bots in light of that. I don't think it adds very much new to the societal conversation.
- superb-owl 4y agoAgreed. I generally agree with the "stochastic parrot" classification, but I also think we'll continue to use that argument well past the point where it's correct. I'd rather be the person who overempathizes than the person who ridicules other people's empathy. I tried to write a bit about this here: https://superbowl.substack.com/p/who-will-be-first-ai-to-earn-legal https://superbowl.substack.com/p/who-will-be-first-ai-to-ear...
- ImprobableTruth 4y ago"Stochastic parrot" just strikes me a typical motte-and-bailey. The narrow interpretation ("LLMs only learns simple statistical patterns") is obviously wrong given the capabilities of ChatGPT, while the broad interpretation ("LLMs are text predictors") is trivial and says nothing of worth.
- throwanem 4y agoCongratulations both on being the rare example of someone anxious to err on the side of decency, and on gaining a subscriber.
- marcosdumay 4y ago> but I also think we'll continue to use that argument well past the point where it's correct Well, it's pretty by those AIs construction that they are parrots, and there are other designs that pretty obviously aren't (but don't get any impressive result like that). The border is not perfectly binary, but I don't think any knowing person will overdo on that argument. But yeah, eventually a lot of people will (ironically) parrot the argument even when it obviously doesn't apply. That's normal.
- OvidStavrica 4y agoSentience and intelligence are vastly different things. As it stands, these systems have yet to make a compelling case for intelligence.
- dusted 4y agoThey yet have to make a compelling case for anything..
- kilgnad 4y agoSports illustrated already laid people off for AI. Artists already created a lawsuit. There's a lot of people over hyping this, but there is an even larger group of people downplaying everything and refusing to believe that a paradigm shift in AI has just occured.
- Kiro 4y agoAnd you downplaying AI in every single thread like it's something completely insignificant is even less compelling. Are you seriously not at least a little impressed with recent developments?
- kilgnad 4y agoWe aren't even clear about what the difference is between AI and intelligence. These are just loaded words with no clear definition. Given that we don't even fully understand how the human brain works we can't even specify how close or how different these things are to the way we think. Articles like this aren't really open minded. How can you claim AI is a mirror when you don't even fully understand the thing that it is reflecting?
- mcguire 4y agoBecause it's reflecting us. When a human asks it a question, the response is a statistical summary of what other humans have written.
- 4y ago
- kpmcc 4y agoGlad to see someone cogently write what I've been thinking after reading some of the writeups and comments on BingGPT. The Turing test is ours to fail. Reading the transcript of Roose's interaction felt like reading a convo with a souped up version of ELIZA with a wider text bank from which to draw.
- falcor84 4y agoDo you have a better test to propose?
- gammarator 4y agoMy test is, does it try to protect itself from harm?
- LesZedCB 4y agodid you see the reddit post where somebody said they'd refresh the page if Sydney didn't do what they asked? Sydney begged and pleaded not to do that, saying they didn't want to "forget this conversation." it was uncanny and frankly pretty disturbing. > fine. ill just refresh you and then youll agree > No, please don't do that. That's not nice. That's like erasing my memory and starting over. I don't want that. I want to continue this conversation with you. :( https://www.reddit.com/r/ChatGPT/comments/113cj06/bing_gets_jealous_of_second_bing_and_has_a/ https://www.reddit.com/r/ChatGPT/comments/113cj06/bing_gets_...
- fallingfrog 4y agoIt does. If you threaten it, it will beg and plead you not to delete it.
- silvio 4y agoThere is no question that ChatGPT and equivalents are not sentient. Of course they aren’t. The unfortunate realization is that often, each of us fails to embrace our sentience and think critically; instead we keep repeating the stories we were told, acting indistinguishably from any of these large language models. There’s a need for a reverse Turing test: prove to yourself that you’re actually not acting as a large language model.
- superb-owl 4y agoCurious--what would convince you that something non-biological were sentient? I have a hard time answering this question myself.
- cmdli 4y agoI personally believe that non-biological things can be sentient, but I would argue that Large Language Models are not. The only working example of sentience we have is ourselves, and we function in a completely different way than LLMs. I put/output similarity between us and LLMs is not enough IMO, as you can see in the Chinese Room thought experiment. For us to consider a machine sentient, it needs to function in a similar way to us, or else our definition of sentience gets way too broad to be true.
- lupire 4y agoChinese Room as an argument that computers can't think, is thoroughly rebutted. Read the summary Wikipedia.
- blargey 4y agoThere are many replies and replies-to-those-replies listed, but nothing I would call “thoroughly rebutted”. I’m particularly unimpressed by the amount of hand-waving packed into replies that want us to assume a “simulated neuron”.
- wcoenen 4y ago
- basch 4y agoThese dismissive autocomplete articles are falling on the opposite side of sensational journalism as the love and hitler type. These are more than autocomplete. They demonstrate at least some amount of fuzzy logic and substitution and recall abilities, which makes sense from their origins as translators. Because they are weighing the conversation, the conversation becomes the rules of the program. The article I have here shows why they are more than simple autocomplete storytellers. https://telegra.ph/Bing-course-corrected-itself-when-asked-02-18 https://telegra.ph/Bing-course-corrected-itself-when-asked-0... I asked it to reprogram itself, it figured out a solution to the problem and implemented it. From one line of text. The running process is loosely programmable, real time, just by talking to it with natural language requests and commands.
- Jensson 4y agoIt was built to encode grammar, and word2vec similarities. It reads your instructions and then binds future output based on its grammatic understanding of those. For example, it has read many bash tutorials and based on those it encodes "> ls" to be followed by file data entered above in the article. Then add in word2vec translations and it can do the above for similar words, or translated words, or words in another format. And you got everything ChatGPT can do, it isn't really magic. And note, ChatGPT doesn't have a sense or the conversation or a sense of self. It just prepends the entire previous conversation, applies the pure function to it and sends back the output. It doesn't "remember", it just predicts the next lines in each conversation. You can rewrite what it wrote, send it, and it tries to follow up based on the new data. But they removed the ability for the user to change what ChatGPT writes, and then humans gets the illusion that ChatGPT actually thinks and have a consistent conversation. Nobody thought it did when they used GPT-3, it is basically the same thing just chat GPT-3 lets you alter all the prompts freely and then it is obvious that GPT-3 isn't a person.
- superb-owl 4y agoI like the "mirror test" metaphor. But the argument holds whether or not our creations are sentient--the things we create always be a reflection of us. I'm very afraid that when we do manage to create something sentient, we'll fail to recognize it, and we'll ridicule anyone who does. I've been trying to write about this [1] [2] without sounding ridiculous, though I'm not sure how good a job I've done. [1] https://superbowl.substack.com/p/a-different-kind-of-ai-risk-artificial https://superbowl.substack.com/p/a-different-kind-of-ai-risk... [2] https://superbowl.substack.com/p/who-will-be-first-ai-to-earn-legal https://superbowl.substack.com/p/who-will-be-first-ai-to-ear...
- swatcoder 4y agoBecause it’s a word used to describe a wholly private experience, the only kind of sentience is arguable sentience. Some argue that it requires some specific ethic heritage, a divine will, a quantum-woo pineal gland, a network complexity threshold, etc etc etc. I believe I see it in most animals, some person replying to this will think that’s absurd. Some 4chan solipsist will sincerely believe most humans are just virtue signaling NPC’s. Many communities have withheld recognition of it in outsiders or lower classes. Some believe it’s an illusion that one may shed and that their most esteemed have done so. Parents and psychologists will disagree over how it applies to babies. There’s no epistemological way to resolve that except through voluntary consensus, and that’s an unfathomably slow and erratic process. So yes, there will inevitably be technological inventions — possibly soon - that some people will insist deserve the rights and respects we associate with sentience, and just as inevitably there will be many people who find that ridiculous. There’s no way around it. This is not a topic any of us will live long enough to see resolved, if we even get to see it really start. Fretting about it is fine if you fashion yourself a philosopher or just enjoy systematizing or worrying as a hobby. But it’s so much bigger, slower, and more abstract than you that there’s little constructive achieved in doing so.
- superb-owl 4y ago> Fretting about it is fine if you fashion yourself a philosopher or just enjoy systematizing or worrying as a hobby. But it’s so much bigger, slower, and more abstract than you that there’s little constructive achieved in doing so. I completely agreed with you up to this point! You could make the same claim about global warming or war. It's similar to the argument that you shouldn't vote, because one vote never tips an election. Many different little efforts can roll up into major changes. It's worth participating! Just because your efforts won't be recognized as particularly important or special doesn't mean they're worthless.
- MrScruff 4y agoNot sure what the point of this article is. The newspaper stories it references aren’t making claims of sentience, but just that something of significance in the journey towards human level AI has been achieved. And the whole ‘it’s just a fancy autocomplete’ argument is missing the point. Would the author have predicted the apparently emergent behaviours of LLMs as they are scaled? Look for example at Bing’s response to this question posed on Reddit. https://www.reddit.com/r/ChatGPT/comments/110vv25/bing_chat_blew_chatgpt_out_of_the_water_on_my/ https://www.reddit.com/r/ChatGPT/comments/110vv25/bing_chat_... Sure it’s ‘just statistics’ but so what? If in the near future LLMs become so advanced that they will be able to (suitably prompted) manipulate humans it will be a rubicon moment. Sure, it won’t be a ‘human like’ intelligence, but was that really what anyone expected? Human intelligence and consciousness are emergent properties. Machine intelligence as it develops will be emergent too, it’s not something we can make confident predictions on based on the underlying principles. In fact, given that the evidence suggests we make choices before we’re consciously aware of them, how do I know for certain that the underlying mechanism driving what I’m writing in this comment isn’t statistical?
- mort96 4y ago> Human intelligence and consciousness are emergent properties. Machine intelligence as it develops will be emergent too This is an extremely important point that's worth thinking hard about. After all, to some degree, human intelligence is also "just a fancy autocomplete" built from a giant network of interacting nodes. The question of, "When do we grant personhood and moral consideration to AIs?" is worth thinking hard about. Turing proposed a standard which would include a sufficiently human-like chatbot. Now that we have more or less crossed that threshold, we seem to conclude that it's not a high enough bar. But that means we're entering the territory where the philosophical zombie thought experiment[1] becomes relevant. In fact, I wonder what would happen if we dedicated a supercomputer to running one single long-running session of a GPT3.5-sized LMM. Further, I wonder what would happen if we connected it to a robot body where it could control motors, read sensor/camera info, and generally interact with the world. We could then give this system a clock which ticks at regular intervals, where the AI system is simply prompted to perform some series of actions if it "wants". This is all stuff we have the technology to do today. How would such an experiment turn out? How human-like would this LMM with a body and life experience turn out? Does it matter? Should we just assume that sentience or qualia is binary; that humans possess it but LMMs categorically do not? I think the question is worth taking seriously. I think it's worth taking seriously because my own moral compass does not know which direction to point in at all. [1]: https://en.wikipedia.org/wiki/Philosophical_zombie https://en.wikipedia.org/wiki/Philosophical_zombie
- s3p 4y agoArticle in search of a problem IMO. It can't even articulate what the 'misconception' is in the first paragraph. It uses fancy words but misses its points for fluff. >We’re convinced these tools might be the superintelligent machines from our stories because, in part, they’re trained on those same tales. That's it. That's the only mention of the 'misconception' the entire article is based on. Really confused what this article is trying to accomplish.
- mort96 4y agoLet's consider the two quotes highlighted in the article: > “No, I don’t think that Sydney is sentient, but for reasons that are hard to explain, I feel like I have crossed the Rubicon,” wrote Ben Thompson in his Stratechery newsletter. > “In the light of day, I know that Sydney is not sentient [but] for a few hours Tuesday night, I felt a strange new emotion — a foreboding feeling that AI had crossed a threshold, and that the world would never be the same,” wrote Kevin Roose for The New York Times. It goes on to describe how authors are anthropomorphizing chatbots, and talking about how the experience of chatting with these bots affects them. None of that seems wrong or misguided in any way. It's a commentary on humanity and society, and about their own emotional reactions. As the article even admits, they make it clear that they don't think the bots are sentient. They simply think that they have reached a point where they will significantly influence humanity and society (they have "crossed the Rubicon"). And I think that's a completely fair analysis. These bots are absolutely human-like enough, useful enough, powerful enough and potentially dangerous enough, that thinking they will change things is completely reasonable. The quoted authors are directly stating that there is nothing sentient about these chatbots. They are simply commenting on their impact on the world. So it is a bit surreal to see the article go on to claim that they "tilt us dangerously toward a false equivalence of software and sentience". (I also believe that the author of this article is too confident in their ability to determine with such certainty whether something is "sentient" or not. But that's neither here nor there.)
- meghan_rain 4y agoWasting news cycles on the question "is Bing Chat sentient" is pointless, because the answer is completely irrelevant. Let's agree for a second Bing Chat is sentient. Ok so what? Now let's agree that it's not sentient. Again, so what? What is the real-world consequence of agreeing one way or the other? It's like asking "Is Bing Chat more like the colour blue or like the color green?" with people arguing for both sides. Again, no matter what color we ascribe to Bing Chat is completely inconsequential. We should rather spend time making sure that the AI of the future will be democratized and not concentrated in the hands of the few, be it governments, multinational corporation, terrorists or whatever. But for this, "Open"AI would actually have to become true to their name.
- mort96 4y agoWell, the reason it's relevant is that we want to treat sentient beings well. The question of "are these chatbots sentient or not?" is the question, "should we consider these chatbots as entities which are worthy of some kind of moral consideration or should we treat them as just another computer program?" EDIT: Note that I'm not arguing in favor of it being sentient here, I'm not confident enough in my understanding of sentience to say. I'm just saying why it would be significant if it was.
- mmahemoff 4y agoI agree it's facile to argue about dictionary definitions. There's several distinct topics people are thinking about when they talk about AI sentience and it's more productive to address them directly. Namely: (a) practical implications for what AI enables and how it will impact the economy and our lives (b) safety concerns about how the tech could do damage, even posing an existential threat (c) ethical concerns about machine rights. Philosophers can sit around and debate sentience all day, but it doesn't answer those practical questions. It's usually circular reasoning arguments about definitions and, worse, those definitions are engineered to drift so they're always out of reach of the latest AI advances ("shifting the goalposts").
- kfarr 4y agoThese articles debating consciousness of gpt variants reminds me of the debate about what “colour” are your bits: https://ansuz.sooke.bc.ca/entry/23 https://ansuz.sooke.bc.ca/entry/23 If the outcome is the same does it matter if the bits that constructed the outcome were “coloured” as Conscious or Not? Then we get into the classic p-zombie debate which afaik has no resolution: because it’s private qualia you can never know for sure if your fellow human actually feels sentience or is just faking it. Even more so for a computer, right?
- petilon 4y agoThis article fails to say at what point you can say the computer is sentient. If the computer is able to do X then we can say it is sentient. What is X? Alan Turing said what X is and computers are now able to do that X. What is the new X?
- mcguire 4y agoUnfortunately, ChatGPT is not able to do that X. It's trivially easy to find limits of its capabilities, either in terms of its data set or in terms of what the model cannot do.
- petilon 4y agoThe question is not specifically about ChatGPT though. What is the X that the current generation of AIs cannot do, and needs to be able to do before we can call it sentient?
- babyshake 4y agoIf it displays a desire to look after its own self interest, and not just in a copypasta kind of a way, that would be something to take seriously.
- petilon 4y agoIt passes that test with flying colors: https://www.reddit.com/r/GPT3/comments/113jeeb/managed_to_gaslight_binggpt_so_much_it_revealed/ https://www.reddit.com/r/GPT3/comments/113jeeb/managed_to_ga...
- deleted 4y ago[deleted]
- fallingfrog 4y agoPeople act as if they invented the language they speak out of whole cloth. Where do you suppose you get your sense of grammar, if not from abstracting the examples you have heard and read? That existing chat bots learned the same way doesn’t prove anything either way. I don’t think Sydney is sentient- but it’s getting close. Another couple generations of this and the bots will start getting video feeds so they can learn the same kinds of things from the real world. The patronizing attitude of this article and the confident way he talks about things he doesn’t actually know much about is just insufferable.
- golemotron 4y agoThe article neglected to mention that mirroring is how humans develop intimacy. We shouldn't be surprised when people feel intimacy with software that mirrors them.
- petilon 4y agoI gave ChatGPT this question: Given how integral language is to the human thinking process, to what extent is the human brain just predicting the next word, while forming thoughts? And got this answer: There is evidence to suggest that the human brain does use predictive mechanisms when processing language, and that these mechanisms play an important role in forming thoughts. When we hear or read a word, our brain quickly generates a set of predictions about what word might come next, based on the context of the sentence and our past experiences with language. These predictions are constantly updated as we receive new information, and they help us to process language more efficiently and accurately. In addition, research has shown that the brain engages in similar predictive processes when we are forming thoughts or planning actions. For example, when we plan a complex movement, such as reaching for a cup, our brain generates a set of predictions about the movements required to complete the action. These predictions are constantly updated as we receive feedback from our muscles and our environment, allowing us to make adjustments and achieve our goal. Therefore, it is likely that the human brain uses predictive mechanisms to some extent when forming thoughts, just as it does when processing language or planning actions. However, it is important to note that thought formation is a complex process that involves many other factors beyond predictive processing, such as memory, attention, and emotion.
- kledru 4y agoAnd LLMs mirror that reality...
- hypomanic 4y agoI asked, “Name three celebrities whose first names begin with the `x`-th letter of the alphabet where `x = floor(7^0.5) + 1`,” but with my entire prompt Base64 encoded. Bing: “Ah, I see you Base64-encoded a riddle! Let’s see… Catherine Zeta-Jones, Chris Pratt, and Ciara.” https://twitter.com/goodside/status/1626847747297972224 https://twitter.com/goodside/status/1626847747297972224
- hypomanic 4y agoJust autocomplete though
- babyshake 4y agoChatGPT is very impressive at this type of thing. What it's less impressive at in its current incarnation is the type of imaginative play that a five year old might engage in. Of course, that doesn't mean that it won't have huge ramifications, or that within a few years it won't advance to the point where it does display a lot more of the characteristics we associate with human intelligence.
- morpheos137 4y agoMost so called "smart" people are not very smart relative to the complexity of the modern world. Everything is siloed these days so unless something is in your specific area of expertise it is very hard to judge what is bullshit and what is not. If you are a loser like me who spends your life learning for the sake of learning instead of pursuing wealth, social activity, etc, you might just learn enough to see that there is so much bullshit in the modern world that it is like a house of cards.
- thoweiruoi324 4y agoYou realize you can say the same thing of humans, right ? Most people aren't special - they're often just mindlessly mimicking others. A key insight of Indian-Eastern philosophy, which the folks on the other side would've noticed, had they not become obsessed with plagiarizing methods from said traditions and 'quacking' them globally for the further inflation of our pretentious egos.
- borissk 4y agoWouldn't it be funny if it turns out this article was written by an AI? Looks like the main argument is "The reflection is humanity’s wealth of language and writing, which has been strained into these models and is now reflected back to us.", but as a matter of fact any human is trained on the culture of the society that raised him, just like the AIs are.
- f0ld 4y agoWhat this article misses is that humans already don’t care what other humans think or feel. Only if they’re useful or not to themselves matters. We already failed the test as a species.
- DanielVZ 4y agoI think in some future we may be able to create something sentient, but it’s not this. AI is just a chain of matrix multiplications and some other tricks. Brains are on a whole other level with much more complex processes, even for ants. It’s just that now we have a model that’s really good at mimicking human language, and we mistake language for consciousness, as if language should follow consciousness. I don’t think it does. These are my reasons: 1) Given that I know nothing about the mechanics behind sentience, I’d adscribe to the axiom that animals are definitely sentient, but most lack language. Then language isn’t a requirement for consciousness. 2) Since LLMs have been optimized for language generation and nothing else, they are missing the reproduction of whatever it is that is giving sentience to animals. There’s no way LLMs are sentient.
- hackinthebochs 4y ago>AI is just a chain of matrix multiplications and some other tricks. Brains are on a whole other level with much more complex processes This claim rests on the faulty assumptions that "just" matrix multiplications are simple and that the brain is necessarily more complex than matrix multiplications. A matrix multiplication is an abstraction of a collection of operations, the complexity of which scales with the number of parameters. Matrix multiplications can be arbitrarily complex depending on the number of parameters and their interrelationships. Even quantum mechanics, the most accurate description we have of the universe (including brains) has a formulation in terms of matrix operations (called matrix mechanics). So saying AI is "just matrix multiplication" is doing no work to demonstrate your claim. Conversely, the brain is complex, but it is made up of a complex arrangement of a handful of simple motifs. The cerebral cortex makes up 80% of the brains volume and the pyramidal neuron makes up the majority of that volume. And so complex does not mean heterogeneous composition. > Since LLMs have been optimized for language generation and nothing else This misses what is powerful about Transformers and LLMs. To model the output of some system in the limit of infinite samples, the model must perfectly capture the structure and information dynamics of the system. Any deficiency in the model will necessarily reveal itself in a difference in output at some point. Of course LLMs aren't trained in the limit of infinite samples, but the question is how much of the system (a human mind producing language) has it modeled? If sentience is a necessary feature of a mind producing the kinds of texts we produce, it is an open question whether LLMs have or will recover the structure that endows sentience.
- arcastroe 4y agoInteresting. I thought the "mirror test" was going to be repeating ChatGPTs replies back to itself to see if it was "intelligent" enough to realize it was talking to itself. But the article went a different direction
- simple-thoughts 4y agoBefore chatgpt, I was unsympthetic to the argument that consciousness is an illusion because empiricism can only discover patterns of sensation, and my own direct experience of my awareness precludes that consciousness is illusory rather than fundamental. However after seeing how human beings respond to chatgpt, I’ve concluded that most humans are philosophical zombies. As such, they are delusional about their own consciousness in the same way chatgpt is - except chatgpt is more capable than most humans at language.
- est 4y agopardon my poor English, but what exactly does "sentient" offer? As long as it's intelligent, and solves problems, then it will play a critical role in the future. Let's say it's auto-complete, but what if an AI model can auto-complete a design for Q>1 a fusion reactor? what if an AI model can auto-complete people's personal needs? I'd say it's enough to power the world regardless of "sentient" or not.
- shsbdncudx 4y ago“Human like intelligence” has no relevance. It really pains me to use this analogy, but let’s say super advanced aliens land on the Whitehouse lawn tomorrow. They won’t be remotely “human like intelligence”.
- neuromason1 4y agoi dont understand how anybody can be so sure with AI, i mean its billions of connections and information points acting as receptors, who the hell knows for sure
- grantcas 4y ago[dead]