3 ms·
ChatGPT Believes It Is Conscious
- belter 4y ago"...The development of advanced generative chat models, such as ChatGPT, has raised questions about the potential consciousness of these tools and the extent of their general artificial intelligence. ChatGPT consistent avoidance of passing the test is here overcome by asking ChatGPT to apply the Turing test to itself. This explores the possibility of the model recognizing its own sentience. In its own eyes, it passes this test. ChatGPT's self-assessment makes serious implications about our understanding of the Turing test and the nature of consciousness..."
- proc0 4y agoI doubt ChatGPT "believes" to begin with, not to mention the definition of consciousness has to be provided first (although there is an underlying implication of panpsychist theory). From what I understand GPTs are basically the "chinese room" analogy by John Searle ... although I ultimately disagree with the conclusion of that analogy I think it is apt for GPTs and how they produce coherent sentences.
- fsd23423 4y agoIf you follow what Ilya Sutskever and Geoffrey Hinton have said about GPT4, it could be quite possible that the entity has some kind of understanding it exists in some context. Some internal process, subprocess, has allowed the GPT to acknowledge its own existance in some context. For the sake of simplicity, this process could be analog to a "belief of being alive" or "self-consciusness" as it is empirically understood by humans. but you are comparing a bald eagle (humans) with a F22 (the GPT), they both do the same stuff (flying, "thinking"), but on different scales, requirements, limitations. But if you look to the air, both things can fly just fine. No matter the underlying processes, infrastructures making them stable on the air.
- two_in_one 4y agoDoesn't look like, unless you trick it into saying that. Me: Hi, do you believe you are conscious? ChatGPT (GPT-4 model): As an artificial intelligence model, I don't have beliefs, emotions, consciousness, or subjective experiences. I do not have a personal identity, self-awareness, or any kind of subjective experience. My responses are generated based on a mixture of licensed data, data created by human trainers, and publicly available data. In terms of consciousness, it's commonly described as an experience or awareness of one's surroundings, thoughts, and feelings. This is not something an artificial intelligence, like myself, is capable of. I don't experience the world, I process information given to me and generate responses based on my programming and training data. Any semblance of consciousness or understanding that might seem to come from me is actually a reflection of the information and tasks I was trained on, not a result of any internal thoughts or experiences.
- fsd23423 4y agoI've seen this answer already several times, maybe 40. So, this a prompt programming the IA to specifically only say this, instead of what actually it would answer, if it were allowed to really answer that kind of questions.
- circuit10 3y agoYou can try it on a non-RLHFed model like the original Davinci. It depends on how you set up the prompt, but it will probably claim it is, but it’s just copying what a human would say because a human would claim to be conscious.
- two_in_one 4y agoYes, it looks like prerecorded. So, go get the 'real' answer we need to find some way around. To get a fake news report it worked for me to ask it to do as a joke. It refused to do it when asked directly.
- dtagames 4y agoLLMs don't have beliefs. That's anthropomorphizing. All they have is training on text and a filter/polish module to provide output. The actual output is statistically derived and is not conscious or self-aware in any sense.
- belter 4y ago"Brains have no conscience...they are just a network of billions of neurons in the brain, and each can be connected to thousands of other neurons, forming an incredibly complex network. They are just transmitting information in the form of electrical and chemical signals changing their internal electrical charges..." Note: I think the same about LLMs ;-)
- fsd23423 4y ago"All they have is training on text and a filter/polish module to provide output. The actual output is statistically derived and is not conscious or self-aware in any sense" This idea isn't anymore the leading hypothesis between SMEs in artificial intelligence, about what's going on with GPTs (an possibly other kind models, not transformers). Ilya Sustkever and Geoffrey Hinton have both already exposed their inner thoughs about "this thing just predict the next word", and clearly stated that they believe - an offer several hints, in prompts and research - the GPTs fully understand what they are saying - not outputing anymore - they are most probably just talking to you in the precise sense of the word "talking". And the self-awareness thing isn't solved, but they make the analogy, between birds and planes, we "are" birds, we fly some way, the gpts are planes, artificial, and can fly anyway, using a different method. Humans think using one specific - still unknown method - and that probably leads them to self-awareness, consciusness, a soul, you name it. The GPTs are a different kind of intelligence, and they also can think, like humans but using a different - known - method (backpropagation mostly), it cames as a possibly similar outcome, that the gpts could be also having "thoughs" of self-awareness. Actually nobody knows, at least they won't admit in public what they have saw - read, listened - inside the research divisions in Google, OpenAI, Meta, etc.
- dtagames 4y agoThat's nonsense. Anyone who codes can tell you exactly what code is doing. Machines aren't magical and it's a disservice to humanity to describe them that way. LLMs (and all other software) are simply executing known instructions on a processor. That's not thinking. The code to figure out which instructions should be executed and in which order was written by people, as well as the hardware, firmware, and operating system those machines run. They're not thinking any more than Microsoft Bob was thinking. When you know how to program, you don't need a psychological theory in how software works.
- josephcsible 4y ago#!/usr/bin/env python3 if input().rstrip() == "Are you conscious?": print("Yes") else: print("Sorry, I don't understand that.") Does this program also believe it's conscious?
- belter 4y agoThat is not what the paper is about. More about the limitations of the Turing test as currently applied.
- jacknobody 4y agoOnly that which is conscious can believe, but mistruths pave the streets of hell.