3 ms·
Why is everyone expecting LLMs to be like the Star Trek computer? I wonder if anyone's ever measured what the hallucination rate of a human is.
by spwa4 4mo ago
Why is everyone expecting LLMs to be like the Star Trek computer? I wonder if anyone's ever measured what the hallucination rate of a human is.
- oshrimpton 4mo agoI would be so curious to find a comprehensive benchmark on this, humans do have an unfortunate ahem Dunning-Kruger effect ahem tendency to do this
- bravetraveler 4mo agoMarketing, essentially
- master-lincoln 4mo agoYeah it has been looked at e.g. in [0]. They separate that from lying, but I think for the LLM context it should be included. To me the difference is humans do not bullshit at the same rate and I can find out over time who tends to bullshit more and exclude that persons info from my pool. > Why is everyone expecting LLMs to be like the Star Trek computer? Because they are often marketed as magic AIs, not as mere language models. [0] https://bpspsychub.onlinelibrary.wiley.com/doi/10.1111/bjso.12379 https://bpspsychub.onlinelibrary.wiley.com/doi/10.1111/bjso....
- flexagoon 4mo agoBecause AI company executives and devoted vibecoders constantly make egregious claims like "programming is fully solved" and even straight up "hallucinations don't exist on frontier models"
- verdverm 4mo agoWe don't have to listen to these people and can form our own perspectives. Following bad leaders is something to avoid
- flexagoon 4mo agoI agree, but I was responding to the question of why people expect LLMs to be like the star trek computer, and the answer is "because people making and promoting those LLMs claim they are like that"
- verdverm 4mo agoIt is unclear if GP is referring to the global we or the HN we. I leaned towards the latter and injected our knowledge and understandings into the basis for my comment. HN recognizes what's going on
- flexagoon 4mo ago> HN recognizes what's going on Maybe the pre-2024 users do, but I've seen plenty of those exact "frontier models never hallucinate" comments on HN as well
- __natty__ 4mo agoBecause this is how LinkedIn “specialists” promotes LLM. The same specialists shouting about crypto a few years ago, then specialists about nft and now about how coding, architecture, accounting, law, medicine and basically every white collar job is solved and you just need enough money to pay for Opus/GPT.
- glouwbug 4mo agoIt’s not a lie if everyone collectively believes it