3 ms·
How do I know the LLM isn't lying to me? AIs lie all the time, it's impossible for me to trust them. I'd rather just go to the actual source and decide whether
by coldpie 2y ago
How do I know the LLM isn't lying to me? AIs lie all the time, it's impossible for me to trust them. I'd rather just go to the actual source and decide whether to trust it. Odds are pretty good that a programming language's homepage is not lying to me about the language; and I have my trust level for various news sites already calibrated. AIs are garbage-in garbage-out, and a whole boatload of garbage goes into them.
- robrenaud 2y agoThey could provide verbatim snippets surrounded by explanations of relevance. Instead of the core of the answer coming from the LLM, it could piece together a few relevant contexts and just provide the glue.
- nicksrose7224 2y agoThey do this already, but the problem is it takes me more time to verify if what they're saying is correct than to just use a search engine. All the LLMs constantly make stuff up & have extremely low precision & recall of information
- coldpie 2y agoI don't understand how that's an improvement over a link to a project homepage or a news article. I also don't trust the "verbatim snippet" to actually be verbatim. These things lie a lot.
- deleted 2y ago[deleted]
- coldtea 2y ago>Odds are pretty good that a programming language's homepage is not lying to me about the language Odds are pretty good that, at least for not very popular projects, the homepage's themselves would soon be produced by some LLM, and left at that, warts and all...
- cookiemonsieur 2y ago> How do I know the LLM isn't lying to me? How do you know the media isn't lying to you ? It's happened many times before (think pre-war propaganda)
- xigoi 2y agoWe’re talking about the official website for a programming language, which has to reason to lie.