3 ms·
I once asked Perplexity (using Claude underneath) about some library functionality, which it totally fabricated. First, I asked it to show me a link to where i
by ljm 2y ago
I once asked Perplexity (using Claude underneath) about some library functionality, which it totally fabricated.
First, I asked it to show me a link to where it got that suggestion, and it scolded me saying that asking for a source is problematic and I must be trying to discredit it.
Then after I responded to that it just said “this is what I thought a solution would look like because I couldn’t find what you were asking for.”
The sad thing is that even though this thing is wrong and wastes my time, it is still somehow preferable to the dogshit Google Search has turned into.
- eurleif 2y agoIt baffles me how the LLM output that Google puts at the top of search results, which draws on the search results, manages to hallucinate worse than even an LLM that isn't aided by Web results. If I ask ChatGPT a relatively straightforward question, it's usually more or less accurate. But the Google Search LLM provides flagrant, laughable, and even dangerous misinformation constantly. How have they not killed it off yet?
- skissane 2y ago> But the Google Search LLM provides flagrant, laughable, and even dangerous misinformation constantly. It’s a public service: helping the average person learn that AI can’t be trusted to get its facts right
- rpcope1 2y agoHaven't you seen that Brin quote recently about how "AI" is totally the future and googlers need to work at least 60 hours a week to enhance the slop machine because reasons? Getting rid of "AI" summarization from results would look kind of like admitting defeat.
- x______________ 2y agoI concur and can easily see this occurring in several areas, for example with Linux troubleshooting. I recently found myself going down a rabbit hole of ever-increasing complicated troubleshooting steps with command that didn't exist, and after several hours of trial and error, gave up after considering the next steps brick-worthy of the system.. Dgg'ing google is still a better resort despite the drop in quality results.
- 1oooqooq 2y agostep 1, focus on llm that generate slop. wait google get flooded with slop step 2, ??? (it obviously is not generating code) step 3, profit!
- firecall 2y agoOften preferable to API documentation too! Claude at least will give me an example relevant to my code with real world implementation code.
- Alifatisk 2y agoHow is Perplexity even able to give invalid results? Isn't it parsing the web first then drawing a conclusion?
- econ 2y agoYou can take the invalid and put it on a website...