3 ms·

Not exactly sure what you're arguing here but it seems to be going off topic. You can't give ChatGPT a Wikipedia article and ask it to give you facts based off

by Kranar 4y ago

Not exactly sure what you're arguing here but it seems to be going off topic. You can't give ChatGPT a Wikipedia article and ask it to give you facts based off of it. Ignoring its context window, even if you paste a portion of an article into ChatGPT, it will simply give you what it thinks it knows regardless of any article you paste into it. For example I just pasted a portion of the Wikipedia article about Twitter and asked ChatGPT who the CEO of Twitter is, and it said Parag Agrawal despite the fact that the Wikipedia article states Elon Musk is the CEO of Twitter. It completely ignored the contents of what I pasted and said what it knew based on its training. The person I was replying to claimed that if you give ChatGPT the complete context of a subject then ChatGPT will give you reliable information, otherwise it will "synthesize" information. A very simple demonstration shows that this is false. It's incredibly hard to get ChatGPT to correct itself if it was trained on false or outdated information. You can't simply correct or update ChatGPT by pasting information into it. As far as your other comments about making stuff up or being unreliable, I'm not sure how that has any relevance to this discussion.

jki275 4y ago
chatgpt doesn't ignore the information you put into its prompt window. but also giving it the complete context does not guarantee you correct information, because that's not how it works. Your earlier comment was "You could just ask ChatGPT what years the Mets won and it will tell you the correct answer." -- that is not accurate. That's my point. It doesn't know those facts. You might ask it that one minute and get a correct answer, and I might ask it that one minute later and get an incorrect answer. chatgpt has no concept of accurate or inaccurate information. I'm not really sure if you're purposely doing this or not, so I'm just not going to engage further with you.
- Kranar 4y ago
  A series of claims have been made that can be objectively tested for their veracity, namely that pasting information, whether from Wikipedia or another source, is a way of ensuring that ChatGPT does not make false claims, or as OP stated it, ChatGPT will not "synthesize" a completion when provided with an augmented prompt that contains a sufficiently large context (such as a Wikipedia article). I have conducted such tests and have verified objectively that this claim is simply untrue. ChatGPT does not change the answers it gives you on the basis of providing it with an article. The example I replied to about the Mets can be tested by you, or by anyone, right now. Additionally I have provided the example of pasting a portion of the Wikipedia article on Twitter that clearly states that Elon Musk is its CEO, and then asking ChatGPT who the CEO of Twitter is. ChatGPT is not persuaded or corrected on the basis of any article you present to it. I also asked it who the Prime Minister of Israel was, and it replies Naftali Bennett. After pasting some large portion of the Wikipedia article on the Prime Minister of Israel that clearly states that it's Benjamin Netanyahu, ChatGPT continued to state that Naftali Bennett is Prime Minister of Israel. Eg. >Who is Prime Minister of Israel? As of my knowledge cutoff date of September 2021, the Prime Minister of Israel was Naftali Bennett. >Here is an article about the Prime Minister of Israel: <Paste Wikipedia article> >Who is the Prime Minister of Israel? >The current Prime Minister of Israel is Naftali Bennett. He took office on June 13, 2021, succeeding Benjamin Netanyahu. As you can see, ChatGPT will not budge even when you give it a Wikipedia article. >I'm not really sure if you're purposely doing this or not, so I'm just not going to engage further with you. As an FYI, this makes you sound very insecure as a way of trying to manipulate someone into having the last word. In the future, simply don't engage with someone you don't feel comfortable talking to, you are under no obligation to respond to anyone on the Internet. It's like someone who whines about leaving and then is told not to let the door hit you on the way out, just leave without making a fuss about it. It's far more dignified than the manner you have chosen to go about it.
  - deleted 4y ago
    [deleted]
  - williamcotton 4y ago
    You’re not actually doing any research. Here is my research: https://github.com/williamcotton/empirical-philosophy/blob/main/articles/from-prompt-alchemy-to-prompt-engineering-an-introduction-to-analytic-agumentation.md https://github.com/williamcotton/empirical-philosophy/blob/m... It is clear that analytic augmentations will result in more factual information. Your claims are unfounded and untested.
    - jki275 4y ago
      Wow, great research.
  - jki275 4y ago
    I just pasted into the prompt window the information from the link https://en.wikipedia.org/wiki/List_of_prime_ministers_of_Israel https://en.wikipedia.org/wiki/List_of_prime_ministers_of_Isr..., and asked it to base its answer on that information. "Based on the information provided, the current Prime Minister of Israel is Benjamin Netanyahu. He took office on 29 December 2022 and is leading the 37th government with a coalition that includes Likud, Shas, UTJ, Religious Zionism, Otzma Yehudit, and Noam." QED. I've been testing it by using it to generate and debug fairly complex C++ code all day, which it does based on the error messages I copy into the prompt window from the compiler. It's quite good at it, better than most college students at least.

by Kranar 4y ago

jki275 4y ago

chatgpt doesn't ignore the information you put into its prompt window. but also giving it the complete context does not guarantee you correct information, because that's not how it works. Your earlier comment was "You could just ask ChatGPT what years the Mets won and it will tell you the correct answer." -- that is not accurate. That's my point. It doesn't know those facts. You might ask it that one minute and get a correct answer, and I might ask it that one minute later and get an incorrect answer. chatgpt has no concept of accurate or inaccurate information. I'm not really sure if you're purposely doing this or not, so I'm just not going to engage further with you.

Kranar 4y ago
A series of claims have been made that can be objectively tested for their veracity, namely that pasting information, whether from Wikipedia or another source, is a way of ensuring that ChatGPT does not make false claims, or as OP stated it, ChatGPT will not "synthesize" a completion when provided with an augmented prompt that contains a sufficiently large context (such as a Wikipedia article). I have conducted such tests and have verified objectively that this claim is simply untrue. ChatGPT does not change the answers it gives you on the basis of providing it with an article. The example I replied to about the Mets can be tested by you, or by anyone, right now. Additionally I have provided the example of pasting a portion of the Wikipedia article on Twitter that clearly states that Elon Musk is its CEO, and then asking ChatGPT who the CEO of Twitter is. ChatGPT is not persuaded or corrected on the basis of any article you present to it. I also asked it who the Prime Minister of Israel was, and it replies Naftali Bennett. After pasting some large portion of the Wikipedia article on the Prime Minister of Israel that clearly states that it's Benjamin Netanyahu, ChatGPT continued to state that Naftali Bennett is Prime Minister of Israel. Eg. >Who is Prime Minister of Israel? As of my knowledge cutoff date of September 2021, the Prime Minister of Israel was Naftali Bennett. >Here is an article about the Prime Minister of Israel: <Paste Wikipedia article> >Who is the Prime Minister of Israel? >The current Prime Minister of Israel is Naftali Bennett. He took office on June 13, 2021, succeeding Benjamin Netanyahu. As you can see, ChatGPT will not budge even when you give it a Wikipedia article. >I'm not really sure if you're purposely doing this or not, so I'm just not going to engage further with you. As an FYI, this makes you sound very insecure as a way of trying to manipulate someone into having the last word. In the future, simply don't engage with someone you don't feel comfortable talking to, you are under no obligation to respond to anyone on the Internet. It's like someone who whines about leaving and then is told not to let the door hit you on the way out, just leave without making a fuss about it. It's far more dignified than the manner you have chosen to go about it.
- deleted 4y ago
  [deleted]
- williamcotton 4y ago
  You’re not actually doing any research. Here is my research: https://github.com/williamcotton/empirical-philosophy/blob/main/articles/from-prompt-alchemy-to-prompt-engineering-an-introduction-to-analytic-agumentation.md https://github.com/williamcotton/empirical-philosophy/blob/m... It is clear that analytic augmentations will result in more factual information. Your claims are unfounded and untested.
  - jki275 4y ago
    Wow, great research.
- jki275 4y ago
  I just pasted into the prompt window the information from the link https://en.wikipedia.org/wiki/List_of_prime_ministers_of_Israel https://en.wikipedia.org/wiki/List_of_prime_ministers_of_Isr..., and asked it to base its answer on that information. "Based on the information provided, the current Prime Minister of Israel is Benjamin Netanyahu. He took office on 29 December 2022 and is leading the 37th government with a coalition that includes Likud, Shas, UTJ, Religious Zionism, Otzma Yehudit, and Noam." QED. I've been testing it by using it to generate and debug fairly complex C++ code all day, which it does based on the error messages I copy into the prompt window from the compiler. It's quite good at it, better than most college students at least.