6 ms·
How do you know the answers are correct? More than once I got eloquent answer that are completely wrong.
by croes 2y ago
How do you know the answers are correct?
More than once I got eloquent answer that are completely wrong.
- brookst 2y agoHow do you address this problem with people? More than once a real live person has told me something that was wrong,
- szundi 2y agoand people just don't know what they don't know - they just answer sillyness the same way
- fzeindl 2y agoYou can divide your approach to asking questions with people (and I do believe this is something people do): 1. You ask someone you can trust for facts and opinions on topics, but you keep in mind that the answer might only be right in 90% of the cases. Also people tend to tell you if the are not sure. 2. For answers you need to rely on you ask people who are legally or professionally responsible if they give you wrong advice: doctors, lawyers, car mechanics, the police etc. ChatGPT can‘t lose it‘s job if it informs you incorrectly.
- dvdbloc 2y agoIf ChatGPT keeps giving you wrong answers wouldn’t this make paying customers leave? Effectively “losing its job”. But I guess you could say it acts more like the person that makes stuff up at work if they don’t know, instead of saying they don’t know.
- Zambyte 2y ago> But I guess you could say it acts more like the person that makes stuff up at work if they don’t know, instead of saying they don’t know. I have had language models tell me it doesn't know. Usually when using a RAG-based system like Perplexity, but they can say they don't know when prompted properly.
- staticman2 2y agoI've seen Perplexity misrepresent search results and also interpret them differently depending on whether GPT4o or Claude Sonnett 3.5 are being used.
- intended 2y agoThere was an article here just a few days ago, which discussed how firms can be ineffective, and still remain competitive. https://danluu.com/nothing-works/ https://danluu.com/nothing-works/ The idea that competition is effective, is often in spherical cow territory. There’s tons of real world conditions which can easily let a firm be terrible at their core competency, and still survive.
- debesyla 2y agoI'm not sure about your local laws, but at least in Lithuania it's completely legal to give a wrong advice (by accident, of course)... Even a notary specialist would at most get to pay a larger insurance payment for a while, because human errors falls under professional insurance.
- staticman2 2y agoYou are contradicting yourself. If the notary specialist needs insurance then there's a legal liability they are insuring against. If you had written "notaries don't even get insurance because giving bad advice is not something you can be sued for" you would be consistent.
- huxley 2y agoWell if you’re a sensible person, you stop treating them as subject matter expert
- croes 2y agoExperience. If I recognize they give unreliable answers on a specific topic I don’t question them anymore on that topic. If they lie on purpose I don’t ask them anything anymore. The real experts give reliable answers, LLMs don’t. The same question can yield different results.
- TeMPOraL 2y agoSo LLMs are unreliable experts, okay. They're still useful if you understand their particular flavor of unreliability (basically, they're way too enthusiastic) - but more importantly, I bet you have exactly zero human experts on speed dial. Most people don't even know any experts personally, much less have one they could call for help on demand. Meanwhile, the unreliable, occasionally tripping pseudo-experts named GPT-4 and Claude are equally unreliably-expert in every domain of interest known to humanity, and don't mind me shoving a random 100-pages long PDF in their face in the middle of the night - they'll still happily answer within seconds, and the whole session costs me fractions of a cent, so I can ask for a second, and third, and tenth opinion, and then a meta-opinion, and then compare&contrast with search results, and they don't mind that either. There's lots to LLMs that more than compensates for their inherent unreliability.
- discreteevent 2y ago> Most people don't even know any experts personally, much less have one they could call for help on demand. Most people can read original sources.
- signatoremo 2y agoWhich sources? How do I know I can trust the sources that I found?
- brookst 2y agoAnd yet here you are making an unsourced claim. Should I trust your assertion of “most”?
- a1j9o94 2y ago
- intended 2y agoIt’s trivial to address this. You ask an actual expert. I don’t treat any water cooler conversation as accurate. It’s for fun and socializing.
- wilg 2y agoAsking an expert is only trivial if you have access to an expert to ask!
- intended 2y agoThis is a true statement. This is also not related to the problem being trivialized in the presented solution. Lack of access to experts, doesn’t improve the quality of water cooler conversations.
- lifeisstillgood 2y agoAnd can judge which one is an expert and which one is bullshiting for the consultancy fee.
- FrustratedMonky 2y agoAnd as we've seen in last few years, large chunks of population do not trust experts. Think this thread has gone from "how to Trust AI", to "how do we Trust Anything".
- m0llusk 2y agoIn my experience hesitating to answer questions because of the complexity of involved material is a strong indicator of genuine expertise linked with conscientiousness. Careless bullshitters like LLMs don't exhibit this behavior.
- Mawr 2y agoI can draw on my past experience of interacting with the person to assign a probability to their answer being correct. Every single person in the world does this in every single human interaction they partake in, usually subconsciously. I can't do this with an LLM because it does not have identity and may make random mistakes. LLMs also lack the ability to say "I don't know", which my fellow humans have.
- synergy20 2y agoso do teachers and books, in the future we need have multiple variants to cross check
- croes 2y agoCross check against what? AI generated texts will flood the internet and burry the real knowledge just like SEO did before. But this time the fake knowledge will be less obvious and harder to check.
- synergy20 2y agomodels from different vendors,plus google search. for serious stuff, we'll still have to check manually ourselves
- bradchris 2y agoIf that turns out to be true, the it looks like AI just gave universities a new reason for being. What a shift from twenty years ago when optimism over “information superhighways” on the “world wide web” would end knowledge gatekeeping and educate the masses, to now— worries of AI slop and finely tuned ML algorithms frying older and younger generations’ brains, while information of human value gets buried, siloed, and paywalled, with no way to verify anything at all.
- superultra 2y agoI give AI a “water cooler chat” level of veracity, which means it’s about as true as chatting with a coworker at a water cooler when that used to happen. Which is to say if I just need to file the information away as a “huh” it’s fine, but if I need to act on it or cite it, I need to do deeper research.
- FergusArgyll 2y agoYes, so often I see/hear people asking "But how can you trust it?!" I'm asking it a question about social dynamics in the USSR, what's the worst thing that'll happen?! I'll get the wrong impression? What are people using this for? are you building a nuclear reactor where every mistake is catastrophic? Almost none of my interactions with LLMs "Matter", they are things I'm curious about, if 10 out of 100 things I learnt from it are false, then I learned 90 new things. And these are things which mostly I'd have no way to learn about otherwise (without spending significant money on books/classes etc.)
- saagarjha 2y agoYes, but how do you know which is which?
- cowsaymoo 2y agoThat is also a broader epistemological question one could ask about truth on the internet or even truth in general. You have to interrogate reality
- radlad 2y agoThat's certainly true, but I think it's also true that you have more contextual information about the trustworthiness of what you're reading when you pick up a book, magazine, or load a website. As a simple example, LLMs will happily incorporate "facts" learned from marketing material into it's knowledgebase and then regurgitate it as part of a summary on the topic.
- 2y ago
- K0balt 2y agoAll you have to do is just remember you’re asking your uncle bob, a man of extensive usually not too inaccurate knowledge. There’s no reason a source has to be authoritative, just because it’s a computer. It is a bit of an adjustment, though. We are used to our machines being accurate, or failing loudly. But, looks like the future is opinionated machines.
- patcon 2y agoThere's something here that I feel is pretty deep, though offensive for some minds: What is the actual consequence of being wrong? Of not getting right the base reality of a situation? Usually, stasis is the enemy that is much great than false information. If people with 90% truth can take a step forward in the world, even if they mistakenly think they have 100% truth, what does it matter? They're learning more and acting more for that step taken. If the mistaken ground truth is false and importantly enough false, they'll learn it bc their experience is grounded in the reality the navigate anyhow. If they don't learn it, it's of no consequence. This is on my mind because I work in democratic reform, and I am acutely aware (from books like "Democracy for Realists", that eviscerate common assumptions about "how democracy works") that it often doesn't matter if we understand how democracy is working, so long as we feel like we do, enough to take steps forward and keep trying and learning. We literally don't even know how democracy works, and yet we've been living under it for centuries, to decent enough ends. I think often about the research of Donald Hoffman. His lab runs evolutionary simulations, putting "creatures" that see "reality" (of the simulation) against creatures that see only "fitness" (the abstraction, but also the lie, that is more about seeing what gets the creature living to the next click of the engine, whether that's truth or falsehood about the reality). https://www.youtube.com/watch?v=oYp5XuGYqqY https://www.youtube.com/watch?v=oYp5XuGYqqY Basically, creatures that see only fitness (that see only the lie), they drive to extinction every creature that insists on seeing "reality as it is". I take this to mean truth is in no way, shape, or form favoured in the universe. This is just a convinient lie we tell ourselves, to motivate our current cultural work and preferences. So tl;dr -- better to move forward and feel high agency with imperfect information, than to wait for a full truthful solution that might never come, or might be such high cost as to arrive too late. Those moving forward rapidly with imperfect information will perhaps drive to extinction those methods that insist on full grounding in reality. Maybe this is always the way the world has worked... I mean, does any mammal before us have any idea how any of reality worked? No, they just used their senses to detect the gist of reality (often heuristics and lies), and operated in the world as such. Maybe the human sphere of language and thought will settle on similar ruthlessness.
- jval43 2y agoIncorrect information by itself is at best useless. Incorrect information that is thought to be correct is outright dangerous. Objective truth is crucial to science and progress. We've come too far since the age of enlightenment to just give it all up.
- tomjen3 2y agoYou enable the search functionality.