3 ms·
The real marketing is in the constant refrain that LLM hallucinations are precisely equivalent to common human behavior, and that LLMs are thus no less reliable
by krapp 3y ago
The real marketing is in the constant refrain that LLM hallucinations are precisely equivalent to common human behavior, and that LLMs are thus no less reliable or accurate than human beings, in order to normalize hallucination as an acceptable (and unavoidable) consequence of integrating LLMs into our workflows.
That despite every example of an LLM failing in production giving results no competent human would actually produce unless they were committing fraud or had severe mental deficiency, that and no one else would find acceptable.
- ben_w 3y ago> the constant refrain that LLM hallucinations are precisely equivalent to common human behavior You sure it's "precisely" and not "analogously"? Ironically, one common human failing is to use binary classification. > or had severe mental deficiency It seems I have worked with more human idiots than you. And at least one time where I was the idiot, despite literally scoring "off the charts" on a cognitive abilities test at school. I'd agree that LLMs are not as smart as humans — they had to read 10% of the internet just to be as competent as an intern — but to me they're more like newspapers and the Gell-Mann Amnesia effect than "severely deficient", even when indeed unacceptable.
- daveguy 3y ago> It seems I have worked with more human idiots than you. This is completely unnecessary.
- ben_w 3y agoThat sounds like you think I'm calling @krapp a member of the set "idiots"; I'm not — ironic that at least one of the two of us is misunderstanding the other, given the question of LLMs not understanding things — rather I'm saying there are many temporarily-idiotic in the world (myself included :P) and I have worked with enough of them to not dismiss the mistakes that LLMs make as a dramatic departure from this.
- daveguy 3y agoAh, you're right. I misread your intent.