3 ms·
> “it knows that it doesn't know” No it doesn’t; it isn’t an intelligence, it’s a token generator based on patterns in the inputs it was trained on (and those
by jodrellblank 2y ago
> “it knows that it doesn't know”
No it doesn’t; it isn’t an intelligence, it’s a token generator based on patterns in the inputs it was trained on (and those are explanations and answers, not millions of people writing “I don’t know”).
- A_D_E_P_T 2y agoRight, but it may be a fixable problem, even under the circumstances. These token generators have vast databases at their disposal and have crawled the entire public-facing internet. They should be able to assign confidence values to their drafts/statements, and reject low-confidence drafts/statements before putting them in front of users. They could do this by fact-checking their drafts in an adversarial way. For instance, a cursory check of isfdb.org would have given ChatGPT better information than I was provided with.