10 ms·
New ways we're tackling spammy, low-quality content on Search
- jerhewet 3y agoAs long as Google doesn't have keyword search it's useless to me. Bring back quotes around a series of words, with an exact match. Bring back +WORD and -WORD to include exact matches and exclude exact matches that I am _not_ interested in seeing. I DO NOT GIVE A FUCK about "popular" or "trending" matches. I want to see results that EXACTLY match what I am looking for. Why is this such an impossible ask for search engines? 15 years ago it was the norm, not the exception. If SEO is the problem, then BLOCK THE SEO TRASH AT THE SOURCE.
- scotty79 3y agoYou can use "word" instead of +word. -word is still a thing that works a bit.
- Fricken 3y agoThe acid test: can I find a brownie recipie without any fucking around? ...nope, I still can't.
- scotty79 3y agoMaybe some browser extension that extracts just recipe from all the ads and superfluous narrative crap?
- theamk 3y agoJust opened incognito window and entered "brownie recipe"... the first link is to "Love and Lemons" site which seems pretty good - there is a pretty small introduction, but then there is ingredients list, steps, etc.. top 5 links all look pretty good to me. (At least in web design area... I have no ideas if recipes themselves are tasty or not) Maybe it's a regional thing (I am in the US)? Or your profile is messed up? Try searching in incognito window.
- Fricken 3y agoThe first time I visited "Love and Lemons" (the first non-sponsored link I got) I scrolled down looking for the actual recipie until I gave up. Right before you made this comment I checked again and found the link to the recipie under the introduction as you described.
- satvikpendem 3y agoMost if not all recipe sites have a jump to recipe button, as de facto required by search engines.
- Fricken 3y agoWay too much fucking around.
- Moldoteck 3y agoto click on a button?
- kiicia 3y agoYes, issue is why this button even exist instead of actual content being first and foremost
- Fricken 3y agoYes. I wasn't searching for a button, I was searching for a brownie recipie
- al_borland 3y agoIf the developer has to put that button on the site, they’ve already failed. They know it’s a poor design, and are trying to add features to point to that will absolve them, instead of fixing the core problem which wouldn’t force the user to look for a skip button. First time users of a site have no reason to look for a button like that, when the standard control of every other site for decades has been to scroll. I also just went to the site. When I went to tap the jump link, a modal popped up and blocked me. I dismissed that and tapped the link and it jumped me down the page to yet another request to sign up for a newsletter I don’t want. Now the top 3rd of the page is a video that started to auto-play; I had to tap to dismiss that. When I scrolled into the recipe section I got yet another modal trying to get me to sign up for an account so I can save the recipe… as if bookmarks don’t exist. I dismissed that, and now I can see the recipe. There are 3 ads in the middle of the recipe that break it up, some with more auto-playing video, and the scroll keeps readjusting itself based on ads and BS popping in and out. The bottom of the page also has an ad banner to dismiss, a bookmark icon that bounces occasional (which is certainly just another attempt to get me to create an account), links to other recipes are sliding in and out depending on the direction I scroll, to try to get me to go other places on the site… and to top it off, the Pinterest flag blocks content, depending on where I scroll, while sometimes being blocked itself by the aforementioned recipe slide-in. How can anyone defend all this? It’s horrible.
- BugsJustFindMe 3y agoThe article says they're announcing in advance, so maybe whatever they plan to do hasn't happened yet.
- neilv 3y agoNever tell a Googler what the metric is. Cue a flood of aspiring L6 promo packets with detailed numbers on improved brownie recipe ranking.
- reaperman 3y agoHey, as long as it gets Sally’s Baking Addiction[0] ranked at the top I’m all for it. 0: https://sallysbakingaddiction.com/ https://sallysbakingaddiction.com/
- js2 3y agoMy go to site for baking recipes is Smitten Kitchen. https://www.google.com/search?hl=en&q=site%3Asmittenkitchen.com%20brownies https://www.google.com/search?hl=en&q=site%3Asmittenkitchen.... I realize adding `site:...` is probably fucking around. But trust me, her brownie recipes are worth it. :-)
- celdon25 3y agoIsn’t the point of Google search to not have to do that?
- js2 3y agoSure, that's why I added the disclaimer. I'm just trying to help Fricken out with some good brownie recipes. Google lists dozens of recipe sites when I search for "brownie recipes" and honestly, how many different ways can you change a basic brownie recipe. So I'm sure almost any of them will do. Any seems like reasonable result. I'm not sure what algorithm Google should use to pick the best or most reliable recipe site. I just happen to know, having cooked many of SKs recipes, that they are good recipes that almost anyone can follow.
- lmm 3y agoThey're not trying to find a good brownie recipe. They're using it as a test phrase for search engines.
- datavirtue 3y agoMy go-to site is King Arthur's 200th Anniversary Cook Book. Literally zero fucking around, packed with every classic baking recipe known to man, and gobs of straight-forward baking chemistry lessons a five year old could understand. Empowerment.
- datavirtue 3y agoKatherine Hepburn has the brownie thing smacked down. Look no further.
- terribleperson 3y agoI'm sure you have a recipe already, but I'd like to highly recommend Stella Parks' brownie recipe, and even more highly recommend her blondie recipe with malted milk and browned butter.
- blindstitch 3y agoGo back to a simpler time... `before:2015 inurl:blogspot.com`
- buildsjets 3y agoI googled MIL-C-44072 and it popped right up. http://everyspec.com/MIL-SPECS/MIL-SPECS-MIL-C/MIL-C-44072C_24608/ http://everyspec.com/MIL-SPECS/MIL-SPECS-MIL-C/MIL-C-44072C_...
- alfiedotwtf 3y agoI had to squint to see the actual content
- buildsjets 3y agoThat’s what she said about you, too. Hey-o!
- vtns 3y agoI just use the Wikimedia Cookbook: https://en.wikibooks.org/wiki/Cookbook:Table_of_Contents https://en.wikibooks.org/wiki/Cookbook:Table_of_Contents
- minimaxir 3y agoThe post alludes to it, but one of the targets here is AI-generated content. > We’ve long had a policy against using automation to generate low-quality or unoriginal content at scale with the goal of manipulating search rankings. This policy was originally designed to address instances of content being generated at scale where it was clear that automation was involved. > Today, scaled content creation methods are more sophisticated, and whether content is created purely through automation isn't always as clear. To better address these techniques, we’re strengthening our policy to focus on this abusive behavior — producing content at scale to boost search ranking — whether automation, humans or a combination are involved. This will allow us to take action on more types of content with little to no value created at scale, like pages that pretend to have answers to popular searches but fail to deliver helpful content.
- nlh 3y agoAnd I’m reading this to say they can’t reliably detect whether something is AI-generated or not, so they’re not going to try. Whether human or AI or otherwise procedurally generated, sounds like they want to target this kind of low quality long tail search stuff.
- bick_nyers 3y agoI believe it's more about manipulating pagerank with networks of "fake" websites.
- CGamesPlay 3y agoThis seems good though. Reminds me of https://xkcd.com/810/ https://xkcd.com/810/
- esperent 3y agoYes, but not quite. It's that we can't tell the difference between the AI generated SEO spam and the human generated SEO spam, not that the AI has started to generate actually useful websites. And there was already so much human generated SEO spam that it couldn't be effectively moderated, but now the problem is a hundred times worse.
- 35mm 3y agoSo far their solution seems to be ranking Reddit for every query.
- deleted 3y ago[deleted]
- olliej 3y ago[flagged]
- porkbeer 3y ago[flagged]
- magnetowasright 3y agoIt's not that they can't make search good, they absolutely can. They're choosing not to.
- rnd0 3y agoGod's honest truth right there.
- deleted 3y ago[deleted]
- nerpderp82 3y ago[flagged]
- deleted 3y ago[deleted]
- quitit 3y agoThis is a bit tongue in cheek, but it is also kind of true: The easiest way for Google to detect spammy, low-quality content is to ... simply add up the number of Google Ads placements on the page. Those flooding the internet with garbage content are doing so because the verbiage is tightly intermingled with Google Ad placements, that's the business model. Google -could- go a step further and deactivate those accounts, but that would impact their revenue, so nah.
- xnx 3y agoIn general, I believe Google's ranking system attempts to be hands-off and not hard-code what factors might correlate to good/bad rankings, but I do wonder if they had to put in a special rule to ignore any automatic quality signals related to their own ad system (or competitors!). It would make sense to do this for revenue preservation reasons, but I wonder if they also might have to do it for anti-trust reasons.
- quitit 3y agoWhile we're just shooting the breeze, there is still something to what you're saying here. It's a long held complaint that Google's ad/analytics/tracking scripts slow down page load/page render times. It's also long held that Google prioritise speed in rankings. My guess is that they'd be excluding their own scripts and ad load times as part of that page load calculation, even though that is not a genuine result and would down-rank pages that utilise competitor ad platforms.
- Jensson 3y agoGoogle is really bad at large scale coherent strategies. Google search ranking teams are almost completely isolated from Google ad teams. It is like two different companies and cultures, Google ads is run a lot more like Amazon.
- jseliger 3y agoI feel like I've read dozens of announcements from Google regarding its efforts to improve search quality. That can't be literally true, but the sense of deja vu inculcates a certain skepticism. In a links post I just published (https://jakeseliger.com/2024/03/05/links-a-moon-landing-rapidly-advancing-biology-bureaucrats-culture-and-more/ https://jakeseliger.com/2024/03/05/links-a-moon-landing-rapi...), I wrote: Still, the Google search monopoly is under more serious threat than it’s been in the company’s history, and that may inspire real change. Amusingly, I used Google search to try and find a video of Sergey Brin saying that he’s un-retired to come back to work on AI, and Google search didn’t easily find it—but it turned up a bunch of spammy YouTube videos.
- pkoird 3y agoI would really love for Google to provide advanced search capabilities or filters to superusers who know EXACTLY what they are searching for. I wouldn't even mind paying for it tbh.
- wyre 3y agoHave you checked out Kagi? It’s exactly what you’re looking for and more. They have a blog post on the front page rn about their integration with Wolfram Alpha.
- kiicia 3y agoThe more I read about kagi on hn the more it feels like organized shill campaign
- heyoni 3y agoWe just had our daily stand up and I was asked to downvote you. Hi!
- alpaca128 3y ago> integration with Wolfram Alpha That blog post was about the WA founder joining them, I don't remember reading something about integration.
- semolino 3y ago> "By integrating Wolfram Alpha’s extensive knowledge base and robust algorithms into Kagi’s search platform..." https://blog.kagi.com/kagi-wolfram https://blog.kagi.com/kagi-wolfram
- bamboozled 3y agoJust Pay Kagi, they already have all of it and it works, it's in production. Personally, I think they deserve the money, they offered a better paid product and never sold advertisements, which I think is a scummy model.
- iamthepieman 3y agoThe best way to improve Google search results is to stop and use Kagi[0]. Seriously. If you are reading this article and these comments then you must be somewhat interested in search results. Do yourself (and the search world) a favor and subscribe. [0]https://kagi.com https://kagi.com
- ajhurliman 3y agoKagi is head and shoulder better at finding things that are useful. Google is going the way of AOL.
- amf12 3y agoHow do they plan to monetize it? How many people will pay for Search? Will they have an ad-supported version? If so how would their direction be any different when they face the same problems?
- ajhurliman 3y agoIt’s a monthly subscription that apparently a lot of people are willing to pay for, feels like an honest business which is shocking in tech.
- aurareturn 3y agoWe don't know if they're profitable doing this. One day, they might go kaput as well.
- Moldoteck 3y agoat least they said they are
- al_borland 3y agoIn the early days a user could go into their setting, see the cost per search, and the total cost of their use per month, compared to what they paid. I threw some extra money their way when I was my use exceeded what I paid. But that was before they changed up their pricing structure.
- olliej 3y ago"To better address these techniques, we’re strengthening our policy to focus on this abusive behavior — producing content at scale to boost search ranking — whether automation, humans or a combination are involved" But this isn't the problem. People are just generating boatloads of "AI" generated pages with a bunch of ads. They don't need to be #1 in the search list, they just need some of their pages to appear in the search list frequently enough that the ads google places on those pages turn a profit. Which google also knows, but again they're selling the ads, so they're getting a cut of it as well. As long as google doesn't penalize pages on the basis of how many ad services and similar they use (and penalize google ads at the same rate) this will continue, and as long as it continues google profits from it. I get that a number of the engineers might not like that, but enough of them do that they long ago threw out basic privacy, accuracy of search results, and even the relevance of ads.
- squigz 3y agoHow much does one earn from Google Ads?
- bloopernova 3y agoI read that as "New ways we're tacking spammy, low-quality content on Search" An eye opener for me was that I didn't question it. Has Google really fallen so low?
- deleted 3y ago[deleted]
- Joel_Mckay 3y agoSimply add a user call-back rating system, then subtract a factor of 10 for anomalous feedback traffic inconsistent with unique regional ISP blocks and human users. They can't do this as 95% of the internet would disappear overnight including a lot of Google ad revenue. The proposed project has a paradoxical use-case defined, and as such will not function as expected. Where do we send the invoice for stating the obvious? ;-) lol
- fragmede 3y agoIf you think more deeply, you'll realize why that won't work.
- Joel_Mckay 3y agoIt encourages cheats to identify themselves, and automatically identifies hostile population clusters through a clique algorithm. i.e. people get a local version of the results consistent with their local cultural values. You are correct in that the cons/spammers on this forum wouldn't notice anything change from their perspective. Maybe we should deploy it on the ISP DNS servers for fun =)
- dotnet00 3y agoIt'll cause a slew of even more direct manipulation services to pop up to either up-rate the current site or down-rate competitors. Not to mention further fueling cancel culture. What they should do is let people set preferences for how they want domains ranked in their personal results, and then use longer term trends on how those lists evolve.
- Joel_Mckay 3y agoIndeed, initially the stats are random, but Google already blacklists domains that hammer their services. People have tried the click-army approach many times.... only to discover their efforts are fleeting due to cross-checking the rank with CDN and DNS traffic.
- janalsncm 3y ago
- hn_throwaway_99 3y agoMy "bar" for how Google does here is how it treats recipe pages. I absolutely loath what SEO has done for recipe pages, because now essentially every recipe page looks exactly the same: 1. Tons and tons of content about the history of the recipe, how humans first domesticated wheat, when the ancient Egyptians first discovered yeast as a leavening agent, etc. etc. 2. Then, after thousands and thousands of words, there is a short recipe for bread at the bottom of the page. In fairness, this is a hard problem to solve. Some sites (rarely) have good information on techniques or things like substitutions in all that copy. But the vast majority of the time all that copy is just useless drivel to appeal to search engines. So my question is whether a great but pithy recipe for, say, focaccia or whatever would make it to the top of the search rankings, or will Google always favor the verbal diarrhea that sullies all recipe sites these days?
- carlosjobim 3y agoDownload or buy a bunch of recipe books and then search inside them. They're of much greater quality. YouTube cooking videos are also superior in quality to anything you'll find on Google.
- sollewitt 3y agoIs the long text purely for SEO or because a longer page gives more opportunities for ad impressions and higher engagement metrics?
- pests 3y agoRecipes are not copyrightable so the only thing that sets each site apart is the surrounding story and nonsense described above - otherwise every recipe is flagged as duplicate content.
- al_borland 3y agoI think forcing a user to scroll past 20 ads is a huge part of it. Usually by the time I get halfway down the page I give up on the idea of cooking. I sometimes wonder how much of the costs associated with running a website are to pay for all the bandwidth for ads, SEO experts, etc… when a simple site with HTML and a dash of CSS could likely host recipes very cheaply.
- yedava 3y agoAs AI generated content takes over the web, algorithmic search will become increasingly useless. In fact, for many things - like what to buy - it already is useless. Your best bet is asking your family/friend/neighborhood groups. If I had trillions like google does, I'd invest in hiring a whole bunch of humans to curate a search index that is actually useful. It's something a new player will never be able to scale up to.
- nottorp 3y agoRight, LLMs will change the world, we know. Algorithmic search has been useless for 5+ years. LLMs will just generate those spam pages faster, but they're already there.
- shuntress 3y agoIt seems like it shouldn't be too hard for Google to create an AI filter that recognizes spam. They obviously have the training data. Even if they needed to manually label a bunch of it. The problem must be that they make too much money from the web pages that are just "500 words rephrasing the headline plus constantly-refreshing ads between every paragraph"
- DinaCoder99 3y ago> As AI generated content takes over the web, algorithmic search will become increasingly useless. This honestly seems unrelated to their poor search quality—hell, I'm even open to AI generated content for some queries. I blame catering to their clients and attempting to manipulate the content on the internet in the name of SEO for why I find useful results buried beneath products and ads.
- kristofferR 3y ago> Your best bet is asking your family/friend/neighborhood groups. Where should the ones you ask get information about the best options? It seems much more likely that someone bought something for the wrong reason (easiest to find, being fooled by fake reviews etc) and then are recommending it onward because they are reasonably happy with it.
- janalsncm 3y agoSomeone should roll out a new tool to rerank Google’s results by the inverse of the number of ads on the page of each.
- paradox460 3y agoSo... Kagi?
- zihotki 3y agoIt's funny how they avoid using 'AI' term in the post when mentioning the reasons of spam. Given that Google is now an AI company, it may create a bad impression.
- tidenly 3y agoIronically this blog feels like it was written by an SEO bot. There's basically no meat to what it's saying and spends each paragraph rephrasing the title without adding anything.
- lupire 3y agoThe preferred term is GenAI
- deleted 3y ago[deleted]
- rickcarlino 3y agoThey make one mention of obituary spam but then fall short of mentioning other specific issues they are going to fix. I’m not convinced this is going to lead to real change (like the last announcement). Let’s see what happens.
- Moldoteck 3y agonot sure why google doesn't launch google search pro with functions similar to kagi with more customization...
- afp14 3y ago[flagged]
- darkteflon 3y agoThey’ve known about this for years and have done nothing about it because it’s working exactly as intended, and there were few decent alternatives available to us. Now we’re supposed to believe they definitely haven’t been abusing their monopoly, have just realised all this and are taking this grave threat to quality search Very Seriously Indeed, to ensure that you, dear customer, can find what you need. Couldn’t possibly have anything to do with encroaching threats to their core business. Google: it’s been obvious for a good many years that you think us all a bunch of fucking peons. I, for one, will enjoy watching you and your clusterfuck of a product portfolio go the way of the Yahoo while I funnel my $10/month to Kagi.
- dmuso 3y ago[flagged]
- bdjsiqoocwk 3y agoMost of the low-quality content I used to see on Google was their ads.
- lostruinsofraku 3y agoI am interested to see the results of this. I had Kagi but got rid of it due to the cost. The results were a little better overall, but asking Gemini or Bing gets me to the same place faster most of the time. If I have to search manually, independent of the search engine, I am going to have to open like 3-8 tabs to get my answer most of the time. The difference between having Kagi and not having it is a couple more mouse wheel scrolls and 2-3 more clicks most of the time.
- ermakov 3y agoTry out Perplexity. It’s so much better for me personally usually for such things.
- al_borland 3y agoFor me using Kagi is also a way to help push sites that actually respect the user. My hope is that if it gains enough traction it will force some of these bigger sites to abandon some of their dark patterns. And in the meantime, I get a much better experience with no ads, and constant new features, which makes search feel new and interesting again.
- deleted 3y ago[deleted]
- andrewmcwatters 3y agoI'm interested in entirely private, self-hosted web crawlers. The sort of instance you could set up on a $12/yr VPS to provide search results for small, specific portions of the web that you wouldn't get rich details from Google, Bing, et al. Personally curated search. I don't know of anyone who does this well, unfortunately. As much as I appreciate what Kagi is trying to do, I don't think I necessarily want a replacement for Google. Or if I did, it would have been Google from the 2000s. I want something different and better.
- nairboon 3y agoYaCy might fit your bill: https://yacy.net/ https://yacy.net/ Although, I'm not sure if a $12/y machine has enough space & RAM. But with YaCy you can setup your own crawls and only index the part of the web that you want.
- slipperybeluga 3y ago[dead]
- solresol 3y agoThe expired domain abuse thing --- that's interesting because finding that signal was one of the few things I got done while I was at Google... in November 2006! And I vaguely remember being told that the fix went into the codebase after I identified that it was happening.
- licheness 3y agoInteresting you bring this up. We saw something similar happen at another FAANG where the fake review detection mechanisms that had worked so well were suddenly removed from the codebase, among other quality control safeguards.
- xyzzy123 3y agoSafeguards can hard to fight for when they make key numbers go down but improve something else that doesn't (immediately) show up in metrics.
- licheness 3y agoAgreed, metrics such as customer satisfaction, customer retention, and brand trust.
- plumeria 3y agoI wonder if Google does something to detect fake Android reviews or coordinated review bombing? It seems to me, at least anecdotally, that they don't have effective mechanisms for this.
- r00fus 3y agoI mean, that was before the Doubleclick merger aka takeover that seemed to plunge Google into profiting from the problem instead of trying to fix it.
- bitcharmer 3y agoIf your fix contributed to reducing ad revenue I can bet my money it was intentionally ignored. This is the only thing that matters to them.
- alfiedotwtf 3y agoUntil Pinterest is gone from search results, I won’t believe them
- deleted 3y ago[deleted]
- Dylan16807 3y agoThis is a perfectly reasonable point/benchmark. I don't know why someone thought it was so bad it needed to be flagged.
- Takennickname 3y agoMy gut feeling to this is "fuck you and I hope you fail for only tackling this after chatgpt threatened your success"
- labrador 3y agoToo little, too late. I've stopped using Google search altogether since I subscribed to ChatGPT and Claude for a nicer, ad free experience