6 ms·
Google Search Is Now a Giant Hallucination
- iLoveOncall 2y ago[flagged]
- infecto 2y agoWhile there is definite hype and buzz among executives to jump on the bandwagon, from my experience and perspective massive amounts of value to be obtained. We are doing work with LLMs that would have previously taken teams of people to do. Many legitimate uses but overshadowed by the hype. I think the way the corporates are applying it are not very useful, specifically the Googles and Microsofts of the world. I am overall bullish on the niche applications of LLM though. Google and Microsoft are just throwing it at everything and I don't think much of it is sticking. The Google search experience has definitely downgraded with their AI implementation. Kagi on the flip side has done a much better job imo, it does not get in the way and it is generally answering the question I asked.
- pmlnr 2y ago[flagged]
- iLoveOncall 2y agoAnd yet after years of the technology it's still "to be obtained" and you aren't naming any specific usecase.
- infecto 2y agoI am bullish in areas outside of RAG/chatbots that gain so much of the hype. Classification, extraction, summarization and similar natural language workflows. My work is net positive but again anecdotal to my corner of the world and the others I interact with. Could be different from your distant side of the world.
- eganist 2y ago> I am still unable to find a single legitimate use. Really? Nothing? Not even really clear-cut use cases that are already in production at a bunch of companies like rapid document templating or surfacing esoteric yet relevant internal documents and knowledge? Those use cases alone have saved seven figure sums at companies where I've seen them implemented. And those savings allowed the positions to be repurposed in more useful ways e.g threat hunts rather than document prep. --- Lots of adjusted goalposts in the comments below. The fact that I can simply ask an LLM to bake me a template and adjust as needed — or ask it to fetch me an internal policy document describing compliance requirements I might need for a new mobile app — and get either of these answers in literally seconds makes them the best tool for the job by a wild margin. And the fact that I'm seeing hiring managers rework their positions for different roles as a result of implementing GenAI to obviate mundane job responsibilities supports this. Many practitioners across many fields have their blinders on with regards to the risk of disruption to their own disciplines. Surprised I'm seeing those blinders on here too.
- iLoveOncall 2y agoThis is not legitimate uses. You can get more consistent and correct results WITHOUT GenAI. All GenAI is good for at best is prototyping to show what COULD be done if you invested the time to do it without GenAI.
- ben_w 2y ago> All GenAI is good for at best is prototyping to show what COULD be done if you invested the time to do it without GenAI. That is the argument used against mechanical freezers replacing natural ice and power looms replacing artisnal weavers and coffe shops replacing real human baristas with identikit machines.
- krapp 2y agoNone of those use cases actually require AI, and each of them is potentially undermined by the tendencies of AI to hallucinate, or as yet unresolved legal questions about the copyright status of AI content. Can you name a use case for which AI was the only or best possible solution?
- estebarb 2y agoI don't agree, but the current usages aren't exploiting its full potential. GenAI is the best that we currently have for parsing natural language, in a way that is multilingual, tolerant 2 tipoz n slang and swearing users. It helps by being a bridge between unestructured data and structured.
- iLoveOncall 2y agoIt's actually terrible at parsing natural language. So bad that on a long enough text (or even short if you're unlucky) it will 100% of the time come up with tokens that are not present in the original text. This sort of rethoric is exactly the same as with crypto "yeah ok it's bad now but think of the future".
- infecto 2y agoSorry you have had such bad experiences we won't be able to convince and nobody can see the future but there are exciting things happening at an amazingly short scale.
- willsmith72 2y agostrong disagree. what's "long enough" to you? i can find huge value out of it parsing natural language at even less than 1000 words. their context is way bigger than that already
- estebarb 2y agoReally? ChatGPT 3.5 and beyond models are fairly capable of understanding PoS and doing text analysis. I have never seen that issue yet with the more advanced models, although smaller/older ones tend to imagine fmthings about the text. Last year I wrote a paper about using LLMs for definition generation for unknown words based on context, and the models did a fairly good job. https://ieeexplore.ieee.org/abstract/document/10346136/ https://ieeexplore.ieee.org/abstract/document/10346136/ if someone is curious. I would like to read prompts where the models are failing in such way. The field is moving quite fast.
- alt0_ 2y ago
- deelowe 2y agoI literally just used OAI to walk through my financial plan and suggest my next steps towards retirement. It pointed out all sorts of things like conversion ladders, my cash on equity for my rental properties, average cost of health insurance and more which would have taken me a ton of time to research on my own.
- baq 2y agoThe genie left the bottle. The Large Bullshit Confabulator revolution is here and either google does it or someone else will. Seriously though, Shannon's theory of communication is highly applicable here - AI noise is reducing available bandwidth (in the entropy sense, not in the advertised Mbps sense) of the internet because the noise floor is raising faster than the error correction advances.
- asdfologist 2y agoSummarization Translation Writing emails Code generation ...
- deleted 2y ago[deleted]
- pcwalton 2y agoTo me the most clear-cut benefit of AI is automated content moderation. People literally get PTSD from moderating Facebook. It's no different from replacing the most hazardous factory work with robotic automation. You will still need a human in the loop for the more difficult cases, of course, but by any reasonable utilitarian calculation AI content moderation is a win. (I'm not implying anything about whether or not LLMs are good for Google search.)
- Terr_ 2y ago> To me the most clear-cut benefit of AI is automated content moderation. Maybe someday but not with LLMs, which by nature do not understand who's talking, who is being quoted, and who is being falsely quoted. > Let’s say that we have a forum where there is only one rule: You cannot talk about your favorite color. https://systemweakness.com/attacking-large-language-models-37229085d4ff https://systemweakness.com/attacking-large-language-models-3...
- pcwalton 2y agoDetermining the veracity of quotes and people's favorite colors are not the kinds of moderation tasks that give people PTSD.
- ben_w 2y ago> Maybe someday but not with LLMs, which by nature do not understand who's talking, who is being quoted, and who is being falsely quoted. Exact opposite. Humans don't have time to work out any of those things in practice. Machines do have time, and LLMs make a much better job of those things given the real limitation on human labour that actually exist in practice.
- ben_w 2y agoThis kind of absolutism always surprises me. I get "it's not good enough". I get "even occasional mistakes are unacceptable in my field". I get "it's not really intelligent" even though I think that's a question of terminology. I don't get "worse than crypto" or "unable to find a single use".
- iLoveOncall 2y agoI didn't say it's worse than crypto. Just a biggest waste of resources by tech companies. Crypto never got investment from tech companies, but those have already diverted millions of hours of work from other projects to shoehorn GenAI garbage everywhere they can. Similarly, I didn't say I wasn't able to find a use. Just not a legitimate use. Something that is a net positive to society and couldn't be done better without GenAI.
- ben_w 2y ago> I didn't say it's worse than crypto. Just a biggest waste of resources by tech companies. Currently that comment says "the biggest waste of resources of the tech world. Even before crypto." — even if it was not your intent, you wrote something which absolutely can have the meaning I read. > Just not a legitimate use No true scotsman. For any value of X, at least one person will claim that X is not "legitimate". I, like everyone else here going "WTF?" at you, find it totally legitimate despite its flaws.
- jerojero 2y agoHonestly it's becoming impossible to find information on the web. A friend of mine wanted to find some lyrics and the lack of proper verbatim mode has made it impossible to know if he had the wrong lyrics or if the information is not there or if the search itself is failing. If there are no matches whatsoever then tell me there's no matches. If there's partial matches tell me how close it is to my search terms. Like you might match all but one or two words and so on. These are the kind of useful features I'd expect on search. The usefulness of AI, on my mind, might be more towards interpretation of the questions rather than generation of the answers. If I were Google I'd try something like using genAI to rephrase the question to extract keywords and so on that can be used to enhance search. But then again, I think I put myself in a position of "how do we make search better and more accurate" and that's simply not the position Google finds themselves in.
- leduyquang753 2y agoYour friend can still enclose the phrases of the lyrics with double quotes to force an exact match on each of them.
- cma 2y agoNow with verbatim if you have a typo they no longer show the number of results up front so you often don't notice and only get sources with the same typo, furthering the impression that Google's results suck. "Google hides search results count under tools section" https://searchengineland.com/google-hides-search-results-count-under-tools-section-440299 https://searchengineland.com/google-hides-search-results-cou...
- the_snooze 2y ago>Honestly it's becoming impossible to find information on the web. It's because everyone is trying to sell you something, no matter how irrelevant it is to you. The cost of transmitting information at scale is effectively zero, and gen AI makes generating information at scale also zero. It's noise at scale crowding out the non-scalable things that are of actual value to humans. Something has to give.
- jasonjei 2y agoGoogle today feels nothing like the Google 24 years ago. It was magic and reliable and no nonsense. I understand technology needs to change with gamification of SEO but I get so much frustration in my searching and often have to use Google in combination with site filtering keywords (e.g, site:stackoverflow.com). But it would be even more difficult to use if I didn’t even know what sites were trustworthy ``authorities.'' I just wish somebody would disrupt Google like Google did with search and email 2 decades ago. Searching on Alta Vista or Yahoo was a nightmare until Google came into our universe.
- pmlnr 2y ago> It was magic and reliable and no nonsense. The web was different as well.
- jasonjei 2y agoI agree, but I remember when I was a university student I was easily able to search for answers for my queries. I was actually reliving some of my past and I tried to find the same info for a useful epiphany from many decades ago, and I couldn’t find it (even though the same engine gave me the answer decades ago)
- DavidSJ 2y agoWhat was the query and epiphany?
- jasonjei 2y agoOne of them was looking at my old AP US History tests. I don’t have the exam question right in front of me, but I remember getting the answer wrong. I found the correct answer on Google pretty quickly. It was on an obscure fact of some former president. I didn’t find the answer in the first several search result pages. I remember getting the answer within the first 3-4 results when I had looked up why I got it wrong 22 years ago.
- jsheard 2y agoThat deal they made with Reddit to use their comments as training data is paying dividends: https://x.com/Very__Regular/status/1794010853257126316 https://x.com/Very__Regular/status/1794010853257126316
- deleted 2y ago[deleted]
- nimeetshah9 2y agoThis is not how you use Google or search though. All these examples seem like deliberate attempts to get weird/nonsense answers back.
- kevingadd 2y agoThe one I saw that recommended a dangerous mix of cleaning chemicals to clean a washer seemed pretty bad, I've performed that exact search before.
- moralestapia 2y agoCan you point me to the Google Operating Manual?
- gspencley 2y ago> All these examples seem like deliberate attempts to get weird/nonsense answers back. I'm not sure that I agree. If a child hears a rumour, or sees some joke online, that claims that gasoline cooks spaghetti faster they may search to find out if it's legit. During Obama's term, there was a right wing conspiracy theory that gained popularity that claimed that Obama was Muslim. Someone coming across that conspiracy theory years after the fact, completely devoid of any context (ex: a pre-teen who wasn't even alive yet during Obama's term), might do a search to find out if it's true. There WAS an NPR article that cited a study claiming that parachutes are no more effective than regular backpacks. AI results have not been enabled for my Google account yet, and currently if you search for "are parachutes effective?" you get a feature snippet that clips that article and links to it. Now take that link, with all of its context, out of the picture and imagine that someone hears that claim casually and wants to search to see if it's true. Currently, in MY search results, you get the link to the NPR article that not only explains where the claim comes from but gives you the full context with all of the "gotchas." It sounds like with Google AI the first thing you get is a definitive, authoritative claim that no, parachutes are not effective at saving your lives and you might as well jump out of an air plane with your carry-on pack-back on.
- partiallypro 2y agoI just saw an interview with Sundar Pichai and someone showing him the mobile Google search results and how bad they are. It was pretty embarrassing. It's like he doesn't even use his own product. https://youtu.be/lqikP9X9-ws?si=0NAJX5GhzXfhP1t0&t=1524 https://youtu.be/lqikP9X9-ws?si=0NAJX5GhzXfhP1t0&t=1524 Also discussed AI junk and how it is crowding out real content. https://youtu.be/lqikP9X9-ws?si=HknLDI_yaByLoqRO&t=1310 https://youtu.be/lqikP9X9-ws?si=HknLDI_yaByLoqRO&t=1310 Also, Google eating other sites/putting them out of business https://youtu.be/lqikP9X9-ws?si=IXm5MrAj7glGsLC2&t=452 https://youtu.be/lqikP9X9-ws?si=IXm5MrAj7glGsLC2&t=452 Overall a good interview.
- JetSpiegel 2y ago> It's like he doesn't even use his own product Why would he? He has an army of slaves to do his bidding, why would he settle for a crappier version of that?
- shombaboor 2y agoIt's funny (as in not funny) google is blaming the users for uncommon or unusual queries.
- ancien 2y agoStill I like Google, more than bing (copilot) or perplexity! I couldn't be where I am now without google
- insane_dreamer 2y agoExample from a few days ago, the first time I decided to use the AI Google Search: I Googled for how to reset the time on my Nixon Ripley watch (I forget the exact search term I used). Google "AI" helpfully brought up a list of instructions, prefaced with a helpful "to reset the time on a Nixon Ripley watch ..." But the instructions referred to a mode that's not on this watch, which was suspicious. It helpfully included a link to a website with a set of instructions that looked like what the AI had generated. Except that the website didn't reference the Nixon at all, but some other watches (Casio gShock, I think), and so the instructions of course didn't work. So I went back to the "old fashioned" way of searching the links for the actual Nixon website, finding the watch manual, with the correct steps.
- pimlottc 2y agoThat seems pretty par for the course with Google these days. “Hmm, you want to know something about a specific watch? Well, I know something else about watches!”
- busymom0 2y agoIt seems like LLM is good at broad and generic things but fail miserably at precision. And instead of admitting it doesn't know something, it confidently responds with nonsensical answers.
- nickpsecurity 2y agoI thought the commenter was talking about Google Search. It sometimes pushes similar sites you don’t want that might generate more ad revenue. Now, they have two products that do this.
- Izkata 2y agoThey were talking about something they did through Google Search, but it hasn't been just search for a long time. Pretty often it'll add a section on top of the search results that attempts to answer a question directly, using data pulled from sites, instead of linking to another site. This feature has existed since long before LLMs, but it sounds like they may have mixed that into there too.
- mensetmanusman 2y agoThe end of the internet came sooner than expected. I wonder how long it took on alpha centurion. It’s not obvious ‘attention is all you need’ would have been a public disclosure by a corporation in parallel worlds. Usually such inventions are buried.
- duringmath 2y agoIt's not even hallucinating it's just correctly summarizing the wrong thing. Also we're only talking about a handful of examples out of billions of queries, that doesn't stop the usual media hyperventilating though.
- kevingadd 2y agoIt only takes a reply to a handful of queries to get a handful of people actually hurt by telling them to do something dangerous. The average person doesn't necessarily have the media and AI literacy to know not to trust papa google's answer at the top of the result page.
- duringmath 2y agoDespite some evidence to the contrary I believe most people aren't that stupid and the "average person" isn't actually typing in these queries, these are marginal cases played out for meme value.
- lubujackson 2y agoIt highlights the underlying problem, which is that Google has built up trust over 20 years that they will return the best results from the web. Now they undermine that trust by shoving AI results at the top and calling it answers. It doesn't take much imagination the think of non-meme questions that will propogate wrong information. "Fake info from trusted sources" isn't a hypothetical issue. When they changed the law that required TV news to be factual we quickly headed down the path of Fox News and MSNBC. They are so effective precisely because Boomers grew up fully trusting news sources. You can argue that it is not a problem and that people know the difference, but we have plenty of real-life proof to the contrary.
- duringmath 2y agoMore consequential queries probably have better safeguards, this hullabaloo is about long tail nonsense that doesn't matter, they're kinks to be ironed out.
- agilob 2y agoI stopped using google search a few years ago, for 95% of the time I use DDG (and then sometimes I do a fallback !g), but as it was down yesterday (thanks to Microsoft) I had to use GS a few times. Never before I had to add `-phrase` so often to eliminate results I didn't want to see. I was looking for some podman tips and had to keep adding -kubernetes and -openshift to every single query. It really just showed me how much worse GS became since I left it, but also no regrets.
- routerl 2y ago> Never before I had to add `-phrase` so often to eliminate results I didn't want Remember when Google broke boolean search operators because they wanted "Google+" to come up first? They've been making unspeakably bad decisions about search for a looong time, at this point.
- dang 2y agoRecent and related: Google AI recommends adding Elmer's glue to pizza cheese after scanning Reddit - https://news.ycombinator.com/item?id=40448074 https://news.ycombinator.com/item?id=40448074 - May 2024 (122 comments)
- jpmattia 2y agoMy favorite so far: https://mastodon.social/@JoeUchill/112493317168967705 https://mastodon.social/@JoeUchill/112493317168967705 > Can I use gasoline to cook spaghetti faster?
- JJMcJ 2y agoI laughed but I can imagine circumstances where errors of this magnitude could cause serious problems.
- spaceman_2020 2y agoAbsolutely ironic that Google for years penalized websites that didn't have all that good "authority" when it came to topics like health and finance ('Your Money or Your Life' - YMYL), and now it ranks its own seriously harmful results right at the top of the page.
- nickpsecurity 2y agoIt’s disturbing how many of these either see humans as worth destroying, could harm us, or would kill us. Getting this AI to Skynet’s morality probably just takes one, fine-tuning run.
- SoKamil 2y agoIf you want to get rid off that, try https://udm14.com/ https://udm14.com/. It will redirect you to tab "Web" which Google secretly added[0] pretty recently. It will show you only text-based links. You can also edit your browser search settings to add this parameter &udm=14 to query automatically. [0] https://x.com/searchliaison/status/1790473952256786805 https://x.com/searchliaison/status/1790473952256786805
- bambax 2y ago> “The thing with Search — we handle billions of queries,” Google CEO Sundar Pichai told The Verge on Monday when asked about the AI overview rollout. “You can absolutely find a query and hand it to me and say, ‘Could we have done better on that query?’ Yes, for sure. But in many cases, part of what is making people respond positively to AI Overviews is that the summary we are providing clearly adds value and helps them look at things they may not have otherwise thought about.” That's a really weird and risky way of putting it. There is a huge difference between being a search engine that finds (external) pages, and coming up with answers in your own name. If some page on the Internet says Obama is a Muslim, who cares, it's not important. But if Google says that Obama is in fact a Muslim, suddenly it's a very big deal. And that's true for every query, on every topic imaginable. Every answer they get wrong attacks their image a little, and out of billions of queries it's inevitable they will get many wrong. This forced, radical change motivated only by fear feels like Google+ all over again. Or New Coke.
- throwitaway222 2y agoIt is highly unlikely it will say that, there's 10000x more articles on the fact that he isn't, and more specifically, the LLM would be "aware" (aware in this sense in that it would have possible next words with high rank) that there is a specific controversy over this. It's the long tail and new stuff that it will get wrong.
- awkwardpotato 2y ago> It is highly unlikely it will say that, there's 10000x more articles on the fact that he isn't Except this was an actual response that it was giving. Tweet from a related HN thread ~yesterday on Google search hallucinations: https://x.com/TVietor08/status/1793768913245020502 https://x.com/TVietor08/status/1793768913245020502
- trehalose 2y agoGoogle saying Obama is Muslim is not a hypothetical. It did say that.
- nerdjon 2y ago
- cdme 2y agoIt went from search to making up utterly unusable dreck. It's not helpful, it's machine-generated nonsense that's more expensive to operate than search.
- snorremd 2y agoAnd this is why I subscribe to Kagi. They also have AI based summary, but you have to invoke it manually on a specific search result (in which case you know where the info is coming from). I feel like we're on a race to the bottom. All of Silicon Valley and beyond have big FOMO on the AI hype train and any and all use of AI pleases investors. I guess we'll see how it all pans out in a few years. One thing is for sure, generative AI and LLMs open up a whole can of worms in terms of disinformation and information noise on the Internet. The signal to noise ratio will greatly shift with these new initiatives.
- spaceman_2020 2y agoKagi is just too expensive for non US folks. The family plan costs more than my family's monthly wifi, netflix, and phone bills combined.
- snorremd 2y agoI can empathize with this. If not for my decent salary by European standards, I’m not sure I would prioritize paying for search when there are free options available. It would be nice if more services used purchasing parity based pricing so more people could benefit.
- dingaling 2y agoIt also stings that I can't pay by PayPal, so not only would I have to pay the currency exchange margin to US Dollars but my bank also changes an out-of-currency fee. I understand that they're probably focusing on US market growth first, but the UK and EU surely have potential too.
- eco 2y agoOh! That's at least one reason why people say they need to pay with PayPal. I've see people saying they won't buy things until PayPal was supported, but I couldn't figure it out for the longest time how anyone would be in a situation where paying with PayPal would be essential. Thanks for explaining that.
- robotnikman 2y agoSaw this post on reddit today where google recommended jumping off the golden gate bridge https://www.reddit.com/r/ChatGPT/comments/1czif9o/willing_to_bet_theyll_turn_this_off_in_just_a_few/#lightbox https://www.reddit.com/r/ChatGPT/comments/1czif9o/willing_to...
- deleted 2y ago[deleted]
- SoKamil 2y agoThis is fake. https://x.com/NorthstarBrain/status/1793977912942575772?t=MoOqlY6nTjMt80Hy-Qr8fQ&s=19 https://x.com/NorthstarBrain/status/1793977912942575772?t=Mo...
- otterley 2y agoIt's fake. https://x.com/NorthstarBrain/status/1793977912942575772?t=MoOqlY6nTjMt80Hy-Qr8fQ https://x.com/NorthstarBrain/status/1793977912942575772?t=Mo...
- silverquiet 2y agoIt occurs to me that I don't know who Alex Northstar is; he could quite simply be an AI creation as well. I now understand why the greybeard dream is to move to an off-grid cabin.
- exitb 2y agoReads like the Golden Gate Claude.
- cortesoft 2y agoI am not as worried about these sorts of ludicrous results as I am the ones that are close enough to correct to be believable. That is where you will get in trouble. I have a similar experience using GitHub Copilot… it usually gets it right, which is great, and sometimes gets it really wrong, in which case I don’t use the suggestion and move on with my work. However, every now and then it will give me a result that really looks correct, but is wrong in some minor way, and I end up getting burned because it takes me way too long to realize where the error is.
- squarepizza 2y agoThe uncanny valley of generated software: utility is inversely proportional to distance from the correct answer, with a huge drop into the dangerously believable.
- ChrisArchitect 2y ago[dupe] More discussion: https://news.ycombinator.com/item?id=40448074 https://news.ycombinator.com/item?id=40448074 https://news.ycombinator.com/item?id=40461580 https://news.ycombinator.com/item?id=40461580
- Aloisius 2y agoI'm not sure how this won't get worse. It seems inevitable that LLMs will be training on more and more data generated by other LLMs creating a hallucination feedback loop.
- berniedurfee 2y agoRecursive garbage in, garbage out.
- arnklint 2y agoGoogle is imploding under AI
- dpflan 2y agoNo wonder these models weren't getting production attention and commercialized when they were invented...
- jayd16 2y agoThey could really just present it as what it is, a _search result_ summary, not an answer summary. Its not like searching for satirical comments should go away. As its presented now it feels very flawed but it doesn't need to be.
- ofrzeta 2y agoFWIW those pull-out answers always were dubious. For instance Google has pulled out answers out of forum threads that were plain wrong, even the original poster conceded that in the thread later but Google just didn't get it.
- Optimal_Persona 2y agoI have been struggling to arrange lawn care for an out-of-state relative while they're incapacitated. While Google search populated some tables in its search results with a bunch of lawn care companies saying the address was in their service area, each and every company I contacted said it was not and asked where I got the info. Visiting each company's site showed they didn't serve this town/address so it's really not clear how/why Google returned those results. In some cases the address was 20 miles from the nearest town served. Whether or not due to AI hallucination, or just general Googlenshittification - not a good result.
- nojvek 2y agoFor all the halballoo about AI safety and laws, Google released it knowing very well about the hallucination. Also it’s so prominent that you can’t even turn it off. How is Google making money on this? It takes so much space, the ads are pushed down even further.
- mococa 2y agoI'm surprised Google hasn't put AI on YouTube: "Feeling a bit down? Here, have some depressive suicidal black metal."