8 ms·
> In particular, what is the point of learning something that is answerable by an AI such as ChatGPT? ChatGPT will often make up an answer which is absolutely
by judofyr 4y ago
> In particular, what is the point of learning something that is answerable by an AI such as ChatGPT?
ChatGPT will often make up an answer which is absolutely incorrect. It will even insist that it’s correct.
It appears that the only responsible way to use ChatGPT is for questions where you already know the answer or can quickly validate the correctness somehow.
- deleted 4y ago[deleted]
- ugh123 4y ago>ChatGPT will often make up an answer which is absolutely incorrect. It will even insist that it’s correct. You're assuming this will be the case forever... check back in a year :)
- warrenm 4y ago>ChatGPT will often make up an answer which is absolutely incorrect. It will even insist that it’s correct. ...just like [some] humans
- alfalfasprout 4y agoI see this parroted but no, it's not like humans at all in this regard. While some humans may speak confidently incorrectly they internally know whether they know something or not. Large language models don't inherently provide an accurate confidence.
- SpeedilyDamage 4y agoThat’s not strictly true, an AI for sure can provide a confidence interval for its answer, but the sentiment I feel is generally correct.
- Retric 4y agoChatGPT can’t provide any score for how correct it’s answer is. Basically everything it says is a lie, some of those lies happen to randomly be true.
- SpeedilyDamage 4y agoIt absolutely can, just check out the OpenAI Azure documentation to understand more: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/reference https://learn.microsoft.com/en-us/azure/cognitive-services/o... Edit: This also might be helpful: https://learn.microsoft.com/en-us/azure/cognitive-services/qnamaker/concepts/confidence-score https://learn.microsoft.com/en-us/azure/cognitive-services/q...
- Retric 4y agoI don’t know what you think that shows, but none of it corresponds to “truth.”
- SpeedilyDamage 4y agoI wasn't trying to suggest it did, just that the concept of "confidence" is a key one in ML.
- Retric 4y agoGotcha. Rereading what I said, “correct” rather than “factual” was poor word choice on my part. From it’s perspective correct is just whatever results in a high score.
- SpeedilyDamage 4y agoYeah, it's well trained by humans who do know what is "factual" (or at least better than ChatGPT does), and the "correctness" score gets used to figure out why ChatGPT gave a "wrong" answer. Over time, the model is trained this way to better align "correct" with "factual", but yeah ChatGPT needs humans to tell it what's "factually" accurate and what's not.
- skizm 4y agoIn what practical or observable sense does that matter if someone never acts as if they know what they're saying is incorrect? Also, assuming the Dunning-Kruger effect is mostly accurate, there will be large portions of the population genuinely believing they are correct when they are not.
- notahacker 4y ago> In what practical or observable sense does that matter if someone never acts as if they know what they're saying is incorrect? People usually do act as if they know what they're saying is incorrect, especially if it's a case of lack of recollection rather than a conscious and strategic lie. ChatGPT defaults to offering a continuation with the correct format and plausible text strings, without regard to truth values it doesn't know because it's indifferent to them. And even if human learning or human motivation did lead a to person to internalise nothing about, say, the titles of scientific papers but the general format and authors well enough to make up similar sounding ones on demand in future, they probably wouldn't be as good as it...
- fsloth 4y agoChatGPT also has no skill whatsoever in logic or deductive arithmetic - just like some humans - but would you want such a human performing professional knowledge work?
- kurthr 4y agoA calculator can do arithmetic so why learn it? Editors have spell check and auto-complete why learn? It's the age old question, if you'll wear diapers when you're 90, why bother with toilet training?
- fsloth 4y agoThis. And on top of that chat gpt is the faulty calculator, spell checker with incorrect syntax, the - thanks for this image - the leaky diaper.
- deleted 4y ago[deleted]