18 ms·
now that is the interesting bit really. what makes the wikipedia based LLM hallucinate less? the only thing i can think of ad hoc is that wikipedia contains le
by em-bee 3y ago
now that is the interesting bit really. what makes the wikipedia based LLM hallucinate less?
the only thing i can think of ad hoc is that wikipedia contains less conflicting or unclear information which helps to avoid the LLM getting confused. also the information is more organized, and it is clear which articles relate to each other.
this would show what i think we already knew that LLMs can summarize the data they get but they can not evaluate or verify it.