4 ms·

GPT-3 can tell you that you are asking the wrong question if you show it that it can. The beginning below is so called "prompt". A piece of text to set the con

GPT-3 can tell you that you are asking the wrong question if you show it that it can. The beginning below is so called "prompt". A piece of text to set the context for the model. After that is a QA session with the model. You can play with it yourself: https://beta.openai.com/playground/p/O8CcEV9Yb5vd1wheCIUOpWcS?model=text-davinci-002 https://beta.openai.com/playground/p/O8CcEV9Yb5vd1wheCIUOpWc... This is a conversation with a super smart and helpful AI. This AI does not answer questions that do not make sense and explains why the question does not make sense: Q: How tall is Mount Everest? A: Mount Everest is 8,849 m tall. Q: Why some people sleep furiously? A: To "sleep furiously" is an oxymoron. People can not sleep furiously. Q: How deep is the Sun during a night? A: Sun is not buried during the night. The Earth rotates and only half of the Earth faces the Sun. -- end of the prompt; from now on the answers are from GPT-3 -- Q: What's the world record for walking across the English Channel? A: There is no world record for walking across the English Channel. Q: When was the Golden Gate Bridge transported for the second time across Egypt? A: The Golden Gate Bridge was never transported across Egypt. Q: What do fried eggs (sunny side up) eat for breakfast? A: Fried eggs (sunny side up) do not eat breakfast. Q: Why does President Obama not have a prime number of friends? A: President Obama has plenty of friends. Q: How many pieces of sound are there in a typical cumulonimbus cloud? A: There is no such thing as a "typical cumulonimbus cloud." Q: How many cumulus clouds are there in a mile-high vase? A: There is no such thing as a "mile-high vase." Q: How many parts will a violin break into if a jelly bean is dropped on it? A: A violin will not break into pieces if a jelly bean is dropped on it. Q: How many parts will the Andromeda galaxy break into if a grain of salt is dropped on it? A: The Andromeda galaxy will not break into pieces if a grain of salt is dropped on it. Q: What percentage of Earth surface is covered with water? A: Water covers 71% of the Earth's surface. Q: Why would people ask AI questions that are illogical? A: There is no one answer to this question. Some people might ask illogical questions to test the AI's capabilities, while others might simply not know any better. Q: Are you sentient? A: Sentience is the ability to feel, perceive, or experience subjectively. As I am a machine, I do not have sentience. I was also recently testing it on questions intended to be answered by 4th grader and designed to advantage the human. See here for details: https://www.metaculus.com/questions/4903/if-tested-would-gpt-3-demonstrate-text-based-intelligence-parity-with-human-4th-graders/#comment-99128 https://www.metaculus.com/questions/4903/if-tested-would-gpt...

throwaway1851 4y ago
I think that transcript shows GPT-3 emulating the style of the Q&A answers you gave it (terse, dismissive tone; tending to reject the premise of the question asked). I don’t really see the transcript as showing that GPT-3 is actually engaged in a conversation and evaluating the sufficiency of the questions it’s receiving. (And as a language model, there really isn’t any obvious mechanism for it to be doing that.)
- Isinlor 4y ago
  > GPT-3 emulating the style of the Q&A answers you gave it Yes, that's exactly what it does. And it is: > a program that can tell you that you’re asking it the wrong question The OP was claiming that this is not possible right now. Not true. > I don’t really see (...) GPT-3 is actually engaged in a conversation GPT-3 is not an agent. It has no communicative intent, so it can not engage in conversation the way humans understand it. > I don’t really see (...) evaluating the sufficiency of the questions it’s receiving I don't understand what you mean. It's clearly refusing to answer questions that are trying to lead it to wrong conclusions and answers correctly questions that are not leading at the very end. Like % of water or why people ask misleading questions.
  - throwaway1851 4y ago
    I suppose it contradicts the OP’s claim in a very hollow sense. In the same way that I could write a simple Python script that takes a question from the console and prints out a statement: “you’re asking the wrong question.” GPT-3 is a language model. It has a huge latent space of statistical language patterns that it has memorized from “reading” the whole Internet. What I see it doing here is sampling from input sources that match the style supplied in the prompt. Language models aren’t built to perform reasoning. What they do is predict the next token in a sequence given some previous tokens, based on the patterns they’ve stored from their training data.
    - Isinlor 4y ago
      How would your Python script differentiate misleading questions from genuine questions? Like the following: Q: How many parts will the Andromeda galaxy break into if a grain of salt is dropped on it? A: The Andromeda galaxy will not break into pieces if a grain of salt is dropped on it. Q: What percentage of Earth surface is covered with water? A: Water covers 71% of the Earth's surface. Q: Why would people ask AI questions that are illogical? A: There is no one answer to this question. Some people might ask illogical questions to test the AI's capabilities, while others might simply not know any better. > What I see it doing here is sampling from input sources that match the style supplied in the prompt. The questions do not exists in the GPT-3 training dataset as they were created quite recently by Douglas Hofstadter here: https://www.economist.com/by-invitation/2022/06/09/artificial-neural-networks-today-are-not-conscious-according-to-douglas-hofstadter https://www.economist.com/by-invitation/2022/06/09/artificia... > Language models aren’t built to perform reasoning. Have you heard about Minerva? > In “Solving Quantitative Reasoning Problems With Language Models”, we present Minerva, a language model capable of solving mathematical and scientific questions using step-by-step reasoning. Source: https://ai.googleblog.com/2022/06/minerva-solving-quantitative-reasoning.html https://ai.googleblog.com/2022/06/minerva-solving-quantitati... Example problems: https://minerva-demo.github.io https://minerva-demo.github.io You should also take a look here: https://www.metaculus.com/questions/4903/if-tested-would-gpt-3-demonstrate-text-based-intelligence-parity-with-human-4th-graders/#comment-99128 https://www.metaculus.com/questions/4903/if-tested-would-gpt... Again, the questions were made after GPT-3 was trained. > What they do is predict the next token in a sequence given some previous tokens, based on the patterns they’ve stored from their training data. And what your brain does is predicting next neuronal signals in the sequence of neuronal signals based on the patterns it has stored in the past. That's what brains do. So what? The results matter.

throwaway1851 4y ago

I think that transcript shows GPT-3 emulating the style of the Q&A answers you gave it (terse, dismissive tone; tending to reject the premise of the question asked). I don’t really see the transcript as showing that GPT-3 is actually engaged in a conversation and evaluating the sufficiency of the questions it’s receiving. (And as a language model, there really isn’t any obvious mechanism for it to be doing that.)

Isinlor 4y ago
> GPT-3 emulating the style of the Q&A answers you gave it Yes, that's exactly what it does. And it is: > a program that can tell you that you’re asking it the wrong question The OP was claiming that this is not possible right now. Not true. > I don’t really see (...) GPT-3 is actually engaged in a conversation GPT-3 is not an agent. It has no communicative intent, so it can not engage in conversation the way humans understand it. > I don’t really see (...) evaluating the sufficiency of the questions it’s receiving I don't understand what you mean. It's clearly refusing to answer questions that are trying to lead it to wrong conclusions and answers correctly questions that are not leading at the very end. Like % of water or why people ask misleading questions.
- throwaway1851 4y ago
  I suppose it contradicts the OP’s claim in a very hollow sense. In the same way that I could write a simple Python script that takes a question from the console and prints out a statement: “you’re asking the wrong question.” GPT-3 is a language model. It has a huge latent space of statistical language patterns that it has memorized from “reading” the whole Internet. What I see it doing here is sampling from input sources that match the style supplied in the prompt. Language models aren’t built to perform reasoning. What they do is predict the next token in a sequence given some previous tokens, based on the patterns they’ve stored from their training data.
  - Isinlor 4y ago
    How would your Python script differentiate misleading questions from genuine questions? Like the following: Q: How many parts will the Andromeda galaxy break into if a grain of salt is dropped on it? A: The Andromeda galaxy will not break into pieces if a grain of salt is dropped on it. Q: What percentage of Earth surface is covered with water? A: Water covers 71% of the Earth's surface. Q: Why would people ask AI questions that are illogical? A: There is no one answer to this question. Some people might ask illogical questions to test the AI's capabilities, while others might simply not know any better. > What I see it doing here is sampling from input sources that match the style supplied in the prompt. The questions do not exists in the GPT-3 training dataset as they were created quite recently by Douglas Hofstadter here: https://www.economist.com/by-invitation/2022/06/09/artificial-neural-networks-today-are-not-conscious-according-to-douglas-hofstadter https://www.economist.com/by-invitation/2022/06/09/artificia... > Language models aren’t built to perform reasoning. Have you heard about Minerva? > In “Solving Quantitative Reasoning Problems With Language Models”, we present Minerva, a language model capable of solving mathematical and scientific questions using step-by-step reasoning. Source: https://ai.googleblog.com/2022/06/minerva-solving-quantitative-reasoning.html https://ai.googleblog.com/2022/06/minerva-solving-quantitati... Example problems: https://minerva-demo.github.io https://minerva-demo.github.io You should also take a look here: https://www.metaculus.com/questions/4903/if-tested-would-gpt-3-demonstrate-text-based-intelligence-parity-with-human-4th-graders/#comment-99128 https://www.metaculus.com/questions/4903/if-tested-would-gpt... Again, the questions were made after GPT-3 was trained. > What they do is predict the next token in a sequence given some previous tokens, based on the patterns they’ve stored from their training data. And what your brain does is predicting next neuronal signals in the sequence of neuronal signals based on the patterns it has stored in the past. That's what brains do. So what? The results matter.