4 ms·

I have found ChatGPT to be factually incorrect in many occasions, what is worse you can ask it for references and it returns very plausible looking Web pages wi

I have found ChatGPT to be factually incorrect in many occasions, what is worse you can ask it for references and it returns very plausible looking Web pages with government domains, but clicking on the links returns 404s. Students are told not to cute Wikipedia, I am not sure if you should even start with ChatGPT. On the other hand I have asked it to explain some different concepts and found it did a really good job. It feels like watching "hackers" explain what they are doing on TV shows. The general audience believes it, but we roll our eyes.

yucky 4y ago
> I have found ChatGPT to be factually incorrect in many occasions, what is worse you can ask it for references and it returns very plausible looking Web pages with government domains, but clicking on the links returns 404s. I have found the same with Google.
- teruakohatu 4y ago
  Did Google invent URLs that never existed?
  - XCSme 4y ago
    No, but ranks websites with incorrect data higher than others with correct factual data sometimes.
  - yucky 4y ago
    Worse, they invented AMP links.
pelorat 4y ago
I think this could be solved by a multi-step approach. The first prompt could instruct the AI to generate search queries for your input. Then you'd take the output for that and do an actual search online. Extract the text of the first relevant hits then feed back that into a new prompt with additional instructions; "find commonality in these blocks of text and generate a summary" or "combine these blocks of text". I think the true power of this tech will be when there's a paid API available and we can hide a lot of back and forth behind a single prompt.
- adz5a 4y ago
  I agree. I used ChatGPT to boostrap a coding session in which I was using a library to describe data structures. My steps were - ask for documentation and examples relevant to the task ahead. - produce some examples - tweak the example using domain-like data - propose a solution using the lib as is - ask for a solution using a different convention than the classic one i kind of think about this as a REPL assistant. very interested in other ways to use it (and the use cases, anecdotally I also used it to try and learn a little bit of COBOL using the same iterative approach)

yucky 4y ago

> I have found ChatGPT to be factually incorrect in many occasions, what is worse you can ask it for references and it returns very plausible looking Web pages with government domains, but clicking on the links returns 404s. I have found the same with Google.

teruakohatu 4y ago
Did Google invent URLs that never existed?
- XCSme 4y ago
  No, but ranks websites with incorrect data higher than others with correct factual data sometimes.
- yucky 4y ago
  Worse, they invented AMP links.

pelorat 4y ago

I think this could be solved by a multi-step approach. The first prompt could instruct the AI to generate search queries for your input. Then you'd take the output for that and do an actual search online. Extract the text of the first relevant hits then feed back that into a new prompt with additional instructions; "find commonality in these blocks of text and generate a summary" or "combine these blocks of text". I think the true power of this tech will be when there's a paid API available and we can hide a lot of back and forth behind a single prompt.

adz5a 4y ago
I agree. I used ChatGPT to boostrap a coding session in which I was using a library to describe data structures. My steps were - ask for documentation and examples relevant to the task ahead. - produce some examples - tweak the example using domain-like data - propose a solution using the lib as is - ask for a solution using a different convention than the classic one i kind of think about this as a REPL assistant. very interested in other ways to use it (and the use cases, anecdotally I also used it to try and learn a little bit of COBOL using the same iterative approach)