5 ms·
Researchers confirm what we already knew: Google results are getting worse
- CharlesW 3y agoDupe from yesterday: https://news.ycombinator.com/item?id=39013497 https://news.ycombinator.com/item?id=39013497
- chankstein38 3y agoTo be fair, this is much more approachable than a dense 16 page white paper.
- CharlesW 3y agoVery fair. I posted because (1) HN guidelines¹, and (2) because there was lots of discussion about it yesterday that may or may not happen again today. ¹ "Please submit the original source. If a post reports on something found on another site, submit the latter."
- chankstein38 3y agoMakes perfect sense! Have a great day!
- kccqzy 3y agoTo be fair if you had read just the conclusion section of the whitepaper you'll find that the research doesn't actually answer the question.
- chankstein38 3y agoI'm not sure why people in comments sections have to be rude by default? The parent commenter was gracious and made a good point and it was a friendly interaction. Neither of us asserted anything about the conclusion or the question. Maybe take a deep breath and count to 10 before commenting next time? It'd be really nice if at least one place was a reprieve from all of the toxic BS that the internet is.
- kccqzy 3y agoIf you come to Hacker News for niceness and kindness, you'll be disappointed. Everyone here is direct to the point of acerbic, argumentative to the point of combative, and somewhat rude. It's a performative erudition that masks recklessness [0]. If you want a reprieve from toxicity, go offline and speak to people in real life. [0]: https://www.newyorker.com/news/letter-from-silicon-valley/the-lonely-work-of-moderating-hacker-news https://www.newyorker.com/news/letter-from-silicon-valley/th...
- nmstoker 3y agoI don't know why Google doesn't grasp the nettle and just not index pages like those super low quality ones (ones that no human is ever ever going to want to view). They could surely infer them via a series of experiments: temporarily backing off on ads to a particular user and see which sites they click through to. They needn't hit their ad revenue much at all, because each user would just be in an experiment briefly, and they would aggregate results to get a general view.
- gigel82 3y agoBecause those crap pages are filled to the brim with Google Ads that make up the most of their revenue, it's a conflict of interest.
- wharvle 3y agoThey used to. For most of the '00s Google'd noticeably exhibit a kind of wave pattern: webspam would creep onto page 1 of results, more and more, then abruptly vanish. Repeat. Cycle of, IDK, a few months. To all external appearances, Google simply gave up on this cat-and-mouse game around '08 or '09. Big sites get ranked high (whatever changed seemed to give those a huge boost, around that time), everything past that's mostly webspam.
- tomcar288 3y ago96% of the web already is not indexed. Clearly there is something wrong with the algorithm they use to determine what should be indexed and what shouldn't. All that AI doesn't seem to help them much
- Cupprum 3y agoIf i may ask where did you get this number? How are the other search engines on it compared to google?
- CSMastermind 3y agoI have no idea where they're getting that number from. The relevant search terms is "Deep Web" (not to be confused with the Dark Web). https://www.sciencedirect.com/science/article/abs/pii/S0306437913000288 https://www.sciencedirect.com/science/article/abs/pii/S03064... The abstract from that article has a good introductory summary.
- deleted 3y ago[deleted]
- the__alchemist 3y agoYet, they're still (for terms I search for; generally technical, journal etc) better than Kagi, Bing, and DDG.
- pllbnk 3y agoI decided to pay for Kagi for a month or two to see for myself what they have to offer. Now, after several months, I don't think I ever want to go back. Sure, I have to pay for it but in return I get relevant results right at the top without having to double check every time if they might have been sponsored. I must admit, occasionally I do still use "!g" but it's for some very specific things and very infrequently.
- wetpaws 3y agoKagi is miles better than bing, google or ddg
- iakov 3y agoIt's really noticeable and really frustrating. A few days ago I've found myself searching in DDG, then switching to Google since DDG gave me no useful results. The first page was blogspam and ads, literally zero relevant links. I suspect most of the results were AI-generated. I wonder how do people still use google to find what the want on the web?
- strict9 3y agoHow much of this is google getting worse vs how much of this is the fact that people aren't creating content on the open web anymore? People complain that you used to get forum posts, blog posts, and guides for specific questions. But most of those have long since migrated to reddit or other social media. Not a fan of google but think we should examine the other side of the coin on this one.
- ace2358 3y agoWhy can’t it show me the good old content on the internet instead of pages of blog spam made by AI? Obviously they used to show me the old content but apparently users only want new content now…
- smegger001 3y agoIts the Signal to Noise Ratio problem. AI generated spam is easier than ever to create and harder to algorithmicly detect. This results in a rapid increase in the volume of webspam.
- ace2358 3y agoThis does not excuse the fact that search results show me things that are unrelated to my search. Not ads, just pages that do not even contain any of my search terms anywhere on the page This isn’t a SNR issue at all.
- ddtaylor 3y agoI don't think that's going to change the fact that every time I search for some basic thing there is a GitHub repository for it somewhere and Google almost always shows me two to three pages of blog spam garbage and stack Overflow copy sites before I can get to it.
- akira2501 3y agoGo to google. Enter search for something very specific like "red baby buggy bumpers." Google decides for some reason that I didn't really mean "red" so it excludes it from the search. Now all my results are randomly relevant. I have to find the little link that says "Include Results with 'red'." Which.. to the google engineers, why do you think I typed that in the first place? Just to waste my own time? Who are you to drop words from my query? I'm not interested in a page of results, I'm interested in ONE RELEVANT thing. They've intentionally made choices that make the product worse. This is just one, I could type up a whole chapter on this anti-pattern nonsense. All they care about is worthless KPIs that don't correctly measure "quality."
- thmsths 3y agoGiven that Google owns Chrome, the most used browser by a wide margin, I am surprised they don't leverage this to improve their search results. The consensus seems to be that SEO has won, that experts are stuffing websites with keywords and the search engines are simply unable to figure out what is good content anymore. So why not use your own browser to measure how people interact with a website? How long do they stay on it? Do they just scroll and exit immediately? Do they seem to have a hard time finding information? Maybe randomly ask people if a website is helpful or not from time to time. Then aggregate that info and score a website. This should cut down on website that have nothing but fluff.
- bad_user 3y agoIf you enable synchronization, even with encryption enabled, by default Chrome shares your browsing history with the purpose of "improving search". The opt-out option is right there in Chrome's settings, which is really creepy actually.
- xerox13ster 3y agoThey don't need to abuse their control of the browser to do this. They were capable of and were inferring this info from people's visits to/from Google to determine whether a page was useful or not. The problem is that SEO outfits gamified that metric as well. The idea of determining whether a site is useful based on how long the user stayed on it only served to cause sites to hide information halfway down the page. That idea is THE CAUSE of the meme about recipe sites telling you how your long-dead great-great-great grandma wrote this recipe for a special event and how it has become a family staple and some of the ingredients might not exist anymore in the same way they did, before they get around to giving you the recipe. Recipe sites were HUGE in the heyday of the DotCom boom and the only way to get your page to rank higher than every other online cookbook was to capture people's attention with a story before showing them what they came there for. If they can just get what they came for and leave, you got downranked as not a useful site.
- BobaFloutist 3y agoAnd now many recipe sites have a link to skip to the recipe, so it's becoming unclear what the benefit is.
- bovermyer 3y agoSomething I've noticed over the past year or so is that I've been increasingly relying on talking to other people directly to answer questions or find interesting things, rather than relying on search engines. I still use search engines (Kagi, specifically), but not to the degree I once did.
- ddtaylor 3y agoI feel bad for kids growing up today in some ways. When I was younger the web was smaller and Google was newer and working better. For the most part if it existed on the internet I basically just had to put a couple words in a box and I'd get to it within a couple minutes and there wasn't that much to go through if I wasn't that accurate with my search terms. Now whenever I use Google to find even the most simplest of things if it's not a local business that has a Google Maps result the results are terrible and I would have to go through too. I watch our kids and their friends do all sorts of other things to find things. This is one of the reasons for the whole "just put reddit at the end of the search" comes from.
- raxxorraxor 3y agoGoogle caused this situation itself. Sites that only wanted to get some clicks always existed. But the scale is due to the modern advertising industry which uses 20% of internet traffic just to serve mostly unwanted ads.
- Workaccount2 3y agoIt's upsetting and troubling how appending "reddit" to a search is your only hope of getting honest information, especially about products. Everything else is ridden with SEO spam and faux reviews with referral links.
- deleted 3y ago[deleted]
- computerliker69 3y agoDoes Reddit have any special controls to stop astroturfing or fake reviews?
- znep 3y agoUsers and (at least before the last run through the meat grinder) moderators.
- 3y ago
- pseudosavant 3y agoDoesn't it seem like search quality everywhere has gone down? Above the fold it is usually only "sponsored" results (ads). Not just Google or the web. Amazon results are garbage now in exactly the same way. Either ad results, or the 'organic' results are heavily SEO'd/gamed. And as much as I love ChatGPT/GPT4, what Bing is doing with GPT4 is an abomination. Feels like Clippy "Looks like you are writing a document" chiming in when you didn't ask, only not as cute as Clippy even. It is a terrible experience for GPT4, and makes using their site for just web search way worse.
- malka 3y agoIt somehow feels like our society is crumbling under its own noise.
- miloignis 3y agoI'll throw in my recommendation for Kagi! Happily paying user. Perhaps my best recommendation is when I am having trouble finding something and tag !g onto my term to use Google instead (a reflex from using DuckDuckGo), Kagi will happily take me to Google where the results are, every time I've done it, much worse. Kagi is exactly what I want my search engine to be, and feels like what Google used to be, to me.
- golf_mike 3y agoI second this wholeheartedly. At first I was skeptical to get a subscription but to be liberated from the big G AND have excellent search is just worth every penny.
- itsdrewmiller 3y agoDan Luu tested Kagi and found it no better than alternatives, but that it has the most inexplicably diehard users out of all the major options out there: https://danluu.com/seo-spam/ https://danluu.com/seo-spam/
- 3y ago
- huevosabio 3y agoI wonder if the rise and fall of social media is just the way we as a market escape SEO blog spam hell. I stopped using FB when the time line became 1% about the people I cared, and 99% about click bait. Market dynamics and the attention arms race seem to push every platform in that direction. Google is facing this. So the response is to move our presence elsewhere, another forum another search, just another platform that hasn't yet been terminally infested by the attention arms race. But with our move, we also sooner or later bring the infestation with us. We are digital nomads, trying to escape plagues that we ourselves bring.
- kccqzy 3y agoSeems to be just reporting on the research already discussed yesterday https://news.ycombinator.com/item?id=39013497 https://news.ycombinator.com/item?id=39013497 HN Guideline: > Please submit the original source. If a post reports on something found on another site, submit the latter.
- iambateman 3y agoThis isn't surprising and it's not AI's fault. Google lives with a structural weakness – they sell display ads directly on websites which get their traffic from SEO. This creates an incentive the size of the GDP of Cameroon* to direct people to websites which make Google money. Suppose you search for green goddess salad dressing. Is that recipe website the best representation of that recipe? No, and it's not close. It is a measurably bad, and measurably profitable, search result. Google is betting, based on trillions of data points, that we are collectively willing to put up with a mediocre experience. -- * Cameroon's GDP is $45B, and Google's display ad business is something like $55B+. Two facts which I gathered by googling. ;)
- stillbourne 3y agoI find I have to end up searching though time in order to get the results I want. Especially as a developer. A bug that has the same error 8 years ago may not be the same bug now. So I tell google to only show results for the last year and tada I get what I want. Usually.
- outcoldman 3y agoDon’t need to be a researcher to notice that. All my last searches at google was always with site at the end. Have not been using google for probably 5 years or so. First DuckDuckGo. Now Kagi. I am so OK to pay for a good search engine. Family Plan.