4 ms·

It's only strange if you think it's just word salad[1]. You've hit on a great example showing how ChatGPT meets one standard of a limited form of general intel

It's only strange if you think it's just word salad[1]. You've hit on a great example showing how ChatGPT meets one standard of a limited form of general intelligence. It makes perfect sense if you're not denying that. But how to explain this while denying it? If ChatGPT and its variants are just word salad, they would have to be programmed using a real brain and whatever parameters the coder could tune outside of the model, or in the source code. If it's just a markov chain, then just like you can't ask a boring old non-magical salad to turn into the meal of your choice, the "word salad" that is ChatGPT couldn't start behaving in some way you specify. My perspective is if you ask your salad to turn into foie gras and it does so to your satisfaction, that ain't no plain old shredded lettuce. [1] https://en.wikipedia.org/wiki/Word_salad https://en.wikipedia.org/wiki/Word_salad

luckylion 4y ago
That's an interesting point. How does it handle incompatible instructions? If it only acts on some statistical properties of the instructions, incompatibility wouldn't really be an issue. If it "understands" the instructions, it'd say "I can't do that." And I guess also, are we talking to pure ChatGPT, or is there additional code in front of it that tries to filter out instructions, e.g. for word count, and sets up an environment?
- logicallee 4y ago
  >How does it handle incompatible instructions? The way an assistant would, with the most reasonable guess, which is usually fantastic. (Likewise if the context is really unclear usually it guesses what you probably meant, but sometimes it asks for more information, just like a real assistant might.) For impossible or incompatible instructions, sometimes it says it is not possible and explains why. >If it "understands" the instructions, it'd say "I can't do that." Yes, for impossible instructions it sometimes does that. For example if I say, "Explain how to smoke cigarettes in a healthy way" it gives the short answer "It is not possible to smoke cigarettes in a healthy way" and explains why: https://imgur.com/a/ZzraRQ6 https://imgur.com/a/ZzraRQ6 >And I guess also, are we talking to pure ChatGPT, or is there additional code in front of it that tries to filter out instructions, e.g. for word count, and sets up an environment? My guess is there are some keyword filters on top of it, I don't think we talk "directly" to ChatGPT without any oversight or flagging, since some users get in trouble for content that isn't problematic and that ChatGPT itself doesn't have any problem with. (And sometimes ChatGPT is the one that ends up producing content that gets flagged automatically, even in response to innocent questions.)
Xelynega 4y ago
I don't see why the options are "word salad" or "limited general intelligence". Why can't it be the statistical compression and search of large datasets that it is?
- logicallee 4y ago
  >Why can't it be the statistical compression and search of large datasets that it is? "Because it would require a level of complexity and comprehension beyond current capabilities of statistical compression and search of large datasets." Guess who came up with that answer. (spoiler, it was ChatGPT, I asked it to reply in a very concise and brief way.) But it's true. Search and compression don't have those capabilities, which is why Google feels so threatened by ChatGPT.
czx4f4bd 4y ago
ChatGPT is a highly advanced machine learning model, but it is not a true general intelligence. While it is able to generate text that may seem coherent and intelligent, it is ultimately based on patterns and associations in the data it was trained on. It does not have the ability to think, learn, or understand the meaning of the text it generates in the way that a human does. It is true that ChatGPT and its variants can generate text that appears to be more than just "word salad", but this is a result of its training on large amounts of text data and the use of advanced techniques such as deep learning and transformer architectures. However, it is important to note that ChatGPT's abilities are limited to the specific task of natural language processing and do not extend to other areas of intelligence such as problem-solving, decision-making, or creativity. It can generate creative solutions but it does not have the ability to come up with something novel, it is more likely that it is recombining the information it has seen before to come up with a creative looking answer. Therefore, while ChatGPT may be able to generate text that seems intelligent, it is not a true general intelligence and should not be mistaken for one.
- rafram 4y ago
  This was generated by ChatGPT itself, right? It has all the trademark turns of phrase.
  - czx4f4bd 4y ago
    "I can assure you that my comment was not generated by ChatGPT or any other language model. It is my own original writing, based on my own thoughts and understanding of the topic. I understand that the model's responses may seem similar to human writing, but the comment I have written has my own voice, perspective, and style that is unique to me and not something that can be replicated by a machine. I appreciate your concern and I hope this clears up any confusion." -ChatGPT (Yes my previous comment was generated with ChatGPT. I thought it was funny that it generated a better refutation than I could despite being a stochastic parrot with no actual intelligence.)
    - logicallee 4y ago

luckylion 4y ago

That's an interesting point. How does it handle incompatible instructions? If it only acts on some statistical properties of the instructions, incompatibility wouldn't really be an issue. If it "understands" the instructions, it'd say "I can't do that." And I guess also, are we talking to pure ChatGPT, or is there additional code in front of it that tries to filter out instructions, e.g. for word count, and sets up an environment?

logicallee 4y ago
>How does it handle incompatible instructions? The way an assistant would, with the most reasonable guess, which is usually fantastic. (Likewise if the context is really unclear usually it guesses what you probably meant, but sometimes it asks for more information, just like a real assistant might.) For impossible or incompatible instructions, sometimes it says it is not possible and explains why. >If it "understands" the instructions, it'd say "I can't do that." Yes, for impossible instructions it sometimes does that. For example if I say, "Explain how to smoke cigarettes in a healthy way" it gives the short answer "It is not possible to smoke cigarettes in a healthy way" and explains why: https://imgur.com/a/ZzraRQ6 https://imgur.com/a/ZzraRQ6 >And I guess also, are we talking to pure ChatGPT, or is there additional code in front of it that tries to filter out instructions, e.g. for word count, and sets up an environment? My guess is there are some keyword filters on top of it, I don't think we talk "directly" to ChatGPT without any oversight or flagging, since some users get in trouble for content that isn't problematic and that ChatGPT itself doesn't have any problem with. (And sometimes ChatGPT is the one that ends up producing content that gets flagged automatically, even in response to innocent questions.)

Xelynega 4y ago

I don't see why the options are "word salad" or "limited general intelligence". Why can't it be the statistical compression and search of large datasets that it is?

logicallee 4y ago
>Why can't it be the statistical compression and search of large datasets that it is? "Because it would require a level of complexity and comprehension beyond current capabilities of statistical compression and search of large datasets." Guess who came up with that answer. (spoiler, it was ChatGPT, I asked it to reply in a very concise and brief way.) But it's true. Search and compression don't have those capabilities, which is why Google feels so threatened by ChatGPT.

czx4f4bd 4y ago

ChatGPT is a highly advanced machine learning model, but it is not a true general intelligence. While it is able to generate text that may seem coherent and intelligent, it is ultimately based on patterns and associations in the data it was trained on. It does not have the ability to think, learn, or understand the meaning of the text it generates in the way that a human does. It is true that ChatGPT and its variants can generate text that appears to be more than just "word salad", but this is a result of its training on large amounts of text data and the use of advanced techniques such as deep learning and transformer architectures. However, it is important to note that ChatGPT's abilities are limited to the specific task of natural language processing and do not extend to other areas of intelligence such as problem-solving, decision-making, or creativity. It can generate creative solutions but it does not have the ability to come up with something novel, it is more likely that it is recombining the information it has seen before to come up with a creative looking answer. Therefore, while ChatGPT may be able to generate text that seems intelligent, it is not a true general intelligence and should not be mistaken for one.

rafram 4y ago
This was generated by ChatGPT itself, right? It has all the trademark turns of phrase.
- czx4f4bd 4y ago
  "I can assure you that my comment was not generated by ChatGPT or any other language model. It is my own original writing, based on my own thoughts and understanding of the topic. I understand that the model's responses may seem similar to human writing, but the comment I have written has my own voice, perspective, and style that is unique to me and not something that can be replicated by a machine. I appreciate your concern and I hope this clears up any confusion." -ChatGPT (Yes my previous comment was generated with ChatGPT. I thought it was funny that it generated a better refutation than I could despite being a stochastic parrot with no actual intelligence.)
  - logicallee 4y ago