2 ms·
>There are errors in humans truth models, yes, but at least they have one. Humans recognize that checking the structure of the text and checking the facts in th
by coldtea 4y ago
>There are errors in humans truth models, yes, but at least they have one. Humans recognize that checking the structure of the text and checking the facts in the text are two different tasks
Asserting that it's "two different tasks" doesn't necessarily make it true.
Humans checking the "structure of the text" stop their check at the text-structure (syntax) layer, whereas humans checking "the facts of the text" also check the validity of what's in the text.
That doesn't mean that the operation they internally perform to do the first task isn't the same as the one for the second task (just with a different goal, so e.g. stopping earlier).
GPT's "checking the structure of the text" happens through the use of weighted connections created after being fed pieces of information.
Human's "checking the structure of the text" also happens through the use of weighted connections created after being fed pieces of information (as encoded in its neurons).
Well, human's "checking of facts" ALSO happens through the use of weighted connections created after being fed pieces of information.
So, why couldn't ChatGPT "checking of facts" exist and work the same way?
At which point is there a necessity for some additional special faculty (and not just e.g. a matter of end-goal setting to calibrate the use of the same capacity of using "weighted connections created after being fed pieces of information")?
We do know that we can ask ChatGPT to check a fact, and it will come with a conclusion about it.
At which point do we need to sprinkle the magical "fact-checking" dust for this to be fact-checking?