4 ms·
>It's a Large Language Model, you should just is like that, it is not a Large Fact Model. Not by design, but the training corpus necessarily includes a lot of
by zahlman 2y ago
>It's a Large Language Model, you should just is like that, it is not a Large Fact Model.
Not by design, but the training corpus necessarily includes a lot of "facts" (claims made by whoever wrote the original text). A model that is trying to output nonfiction on a specific topic, is likely to encounter relatively more models of claims that either actually were incidentally true, or at least have the same general form as true claims without an obvious "tell".
Of course, every now and then it goes off the rails and "hallucinates". Bad luck for the student who doesn't verify the output when this happens (which is probably a lot of students, since part of the motivation to cheat is not knowing the material well enough to do such verification properly).