4 ms·
>If Facebook claims to know more about the world than Wikipedia, it should factcheck itself. This seems like a misunderstanding of what the AI is doing. It doe
by oarabbus_ 4y ago
>If Facebook claims to know more about the world than Wikipedia, it should factcheck itself.
This seems like a misunderstanding of what the AI is doing. It does not "know about the world" or assert knowledge of any kind of truth, other than to check a citation given in a wikipedia article, and attempt to verify the reference actually contains said information.
For example, if I edited a wiki article to state "over 12 million people visit Hacker News every hour" and linked a random HN article claiming nothing of the sort, this AI would attempt to parse my citation and if it was successful determine the reference didn't support the claim.
- laserbeam 4y agoI understand what the AI model claims to want to do. And I can see how Wikipedia can be a decent testbed for the model. But the title "factcheck wikipedia" is not what the model does. At best the model would make bad actors game references the same way people game page rank on google. Sure, deterrent, meh.
- visarga 4y ago"Reference check" is a better way to describe what it does. Under the hood I think it does the classical natural language inference task. There are benchmarks, datasets and papers on this topic. https://paperswithcode.com/task/natural-language-inference https://paperswithcode.com/task/natural-language-inference