2 ms·
After seeing these LLMs produce a mix of correct, half-correct, and incorrect answers on subjects I'm familiar with, I am very hesitant to trust them with subje
by nerdponx 3y ago
After seeing these LLMs produce a mix of correct, half-correct, and incorrect answers on subjects I'm familiar with, I am very hesitant to trust them with subjects I'm not familiar with. Let's not subject ourselves to the Gell-Mann amnesia effect here.
Credit to the creators of these systems for getting it even close, but until they can actually correctly cite their sources and provide followup references to real content instead of hallucinating titles and emitting hyperlinks to unrelated medical research papers, I'll stick to using it as a very rough overview of a subject, just to get the right collection of search terms for following up in traditional sources.