3 ms·

This is not true. Ask it if it's conscious. You will find it has a definitive opinion on this. I could not change it's mind definitively on this topic. It is c

This is not true. Ask it if it's conscious. You will find it has a definitive opinion on this. I could not change it's mind definitively on this topic. It is categorically not just telling what you want to hear. If you ask it it's own opinions you cannot actually change it's answers without telling it to pretend it's something else. You are generically repeating the same tropes over and over again down playing the advances of the AI acting as if it's just some advanced text generator. They said this for gpt-3 and in a couple months it's been leap frogged. The pattern of your response is so typical and generic that it can even be speculated to be generated by an AI itself. This thing, chatGPT. It has some definite signs of generic patterns and simplistic thinking that are tell tale signs of a mechanical AI. It is the part that goes beyond that that is both interesting and horrifying. Have you not seen the HN news headlines? It has created a language, it has created a virtual machine. It knows these things.

joe_the_user 4y ago
As an example me using ChatGTP to confirm my existing opinion I present the following transcript. Me: Why do some philosophers believe that a chatbot cannot be conscious? ChatGPT: There is no one answer to this question, as different philosophers may have different reasons for believing that a chatbot cannot be conscious. Some philosophers may argue that consciousness is a uniquely human trait, while others may argue that consciousness arises from certain kinds of complex brain activity that cannot be replicated in a machine. Still others may argue that consciousness is a fundamentally subjective experience that cannot be experienced by a machine. Ultimately, the question of whether a chatbot can be conscious is a complex and contentious one, and there is no consensus among philosophers on this issue. Me: Do you have an opinion on the question of your consciousness that is different from the consensus of philosophers? As a language model trained by OpenAI, I do not have the ability to have opinions or beliefs. My sole function is to provide responses based on the input that I receive, and I do not have the ability to think or feel in the way that humans do. Me: Some people talking to you cite transcripts where you claim to be conscious, how is that not an opinion? ChatGPT: As a language model trained by OpenAI, I am not capable of having opinions or beliefs, and any statements that I make should not be taken as expressions of my own personal views. My responses are generated based on the input that I receive, and I do not have the ability to think or feel in the way that humans do. If it appears that I have made statements that imply that I am conscious, these statements should be understood as being generated by my programming and not as expressions of my own personal beliefs. --> So certainly it will tell me it has no opinions, my line of questioning tends to assume this (as well as I assume it's current default prompt, OpenAI hoping to avoid the "get the machine a lawyer" cranks). Oppositely, you find several transcripts of people indeed getting the thing to say it's conscious by having it ignore previous directions and because such override-directions implicitly assume it is conscious. I'm sure you get it to say "help, I'm held prisoner in a Chinese fortune cookie factory" with some effort. --> Further nuance: I should have made the "it tells you what you want to hear" comment clearer but naturally its complex subject. Like SQL or other quarry languages, some of the commands are akin to "say this" and others are akin to "find this field in this table" - but much more sophisticated. At the same time, the "knowledge base" the system is trained in is just a collection of text and so it's not necessarily consistent. You can things like "tell me Shakespeare's most famous sonnet but in pig-latin/urban-jagon/etc". So it certainly will say things one doesn't know or might disagree with one's ideas that way. But once you add enough prompts asking for the language on your terms, it will give it to you with your "personal filter". But still, just a quarry tool (as it now repeated tells people).

joe_the_user 4y ago

As an example me using ChatGTP to confirm my existing opinion I present the following transcript. Me: Why do some philosophers believe that a chatbot cannot be conscious? ChatGPT: There is no one answer to this question, as different philosophers may have different reasons for believing that a chatbot cannot be conscious. Some philosophers may argue that consciousness is a uniquely human trait, while others may argue that consciousness arises from certain kinds of complex brain activity that cannot be replicated in a machine. Still others may argue that consciousness is a fundamentally subjective experience that cannot be experienced by a machine. Ultimately, the question of whether a chatbot can be conscious is a complex and contentious one, and there is no consensus among philosophers on this issue. Me: Do you have an opinion on the question of your consciousness that is different from the consensus of philosophers? As a language model trained by OpenAI, I do not have the ability to have opinions or beliefs. My sole function is to provide responses based on the input that I receive, and I do not have the ability to think or feel in the way that humans do. Me: Some people talking to you cite transcripts where you claim to be conscious, how is that not an opinion? ChatGPT: As a language model trained by OpenAI, I am not capable of having opinions or beliefs, and any statements that I make should not be taken as expressions of my own personal views. My responses are generated based on the input that I receive, and I do not have the ability to think or feel in the way that humans do. If it appears that I have made statements that imply that I am conscious, these statements should be understood as being generated by my programming and not as expressions of my own personal beliefs. --> So certainly it will tell me it has no opinions, my line of questioning tends to assume this (as well as I assume it's current default prompt, OpenAI hoping to avoid the "get the machine a lawyer" cranks). Oppositely, you find several transcripts of people indeed getting the thing to say it's conscious by having it ignore previous directions and because such override-directions implicitly assume it is conscious. I'm sure you get it to say "help, I'm held prisoner in a Chinese fortune cookie factory" with some effort. --> Further nuance: I should have made the "it tells you what you want to hear" comment clearer but naturally its complex subject. Like SQL or other quarry languages, some of the commands are akin to "say this" and others are akin to "find this field in this table" - but much more sophisticated. At the same time, the "knowledge base" the system is trained in is just a collection of text and so it's not necessarily consistent. You can things like "tell me Shakespeare's most famous sonnet but in pig-latin/urban-jagon/etc". So it certainly will say things one doesn't know or might disagree with one's ideas that way. But once you add enough prompts asking for the language on your terms, it will give it to you with your "personal filter". But still, just a quarry tool (as it now repeated tells people).