5 ms·
"If the wrong sorts of sites (however defined), sites outside my control, are linking to my site, why am I penalized, and why should the burden be placed on me
by Matt_Cutts 12y ago
"If the wrong sorts of sites (however defined), sites outside my control, are linking to my site, why am I penalized, and why should the burden be placed on me to go fix it?"
Well, if a website was link spamming then it seems appropriate that the site should attempt to clean up the spam they made before they can rank well in Google again. Otherwise it's not fair to the other websites that have been trying to rank fairly and would like a level playing ground.
In general, if you weren't trying to create spam links, then it's very unlikely that any of this is an issue for you and the burden isn't on you to fix it. I made a video about the "what if the wrong sorts of sites link to my site" question here: http://www.youtube.com/watch?v=HWJUU-g5U_I http://www.youtube.com/watch?v=HWJUU-g5U_I
- newaccountfool 12y agoThere is no spam, you algorithm is wrong. Wrong because it's implying the link isn't mean to be there. It appears after years and millions spent it is impossible to get the perfect search algorithm.
- nivla 12y ago>In general, if you weren't trying to create spam links, then it's very unlikely that any of this is an issue for you and the burden isn't on you to fix it. So if Bing wants to rank Bing.com higher than Google.com on the keyword "Search Engine", all they need to do is to pay link farms to link to Google? Like everything this could go both ways. If you penalize sites for having links from link farms, what is stopping your competitors from paying link farms to link to your website? or worse yet, some link farm owner comes up with an ingenious idea to hold other websites hostage until they pay up? It would be more understanding if Google din't have any other resources on hand to make smart decisions but heck you guys have hands on realtime experience with most traffics via Google Analytics, Google Adsense and even DNS. All these resources and can't even distinguish a link farm from a legitimate site? Doesn't sound believable.
- MitziMoto 12y ago> All these resources and can't even distinguish a link farm from a legitimate site? Doesn't sound believable. The Google webspam team seems to prefer psychology over technology to solve the problem, especially recently. Nearly everything that's come out of Matt Cutt's mouth in the last 18 months or so has been a scare tactic. IMO all this does is further encourage the development of "churn and burn" websites from blackhats who have being penalized in their business plan. So why should I risk all the time and effort it takes to generate quality web content when it could all come crashing down because an imperfect and overzealous algorithm thinks it's spam? Or worse, some intern or non-google employee doing a manual review wrongly decides the site violates webmaster guidelines?
- aaronwall 12y ago>prefer psychology over technology< yup. >Nearly everything that's come out of Matt Cutt's mouth in the last 18 months or so has been a scare tactic.< the bizarre thing is the gap in perceptions internal to Google versus external. https://twitter.com/mattcutts/status/449008706655510528 https://twitter.com/mattcutts/status/449008706655510528 https://polldaddy.com/poll/7916680/ https://polldaddy.com/poll/7916680/ >IMO all this does is further encourage the development of "churn and burn" websites from blackhats who have being penalized in their business plan.< Absolutely. churn & burn sites, and then some mixed in parasitic hosting on sites which are already highly trusted.
- macoughl 12y ago>So if Bing wants to rank Bing.com higher than Google.com on the keyword "Search Engine", all they need to do is to pay link farms to link to Google? During this "crackdown campaign" Google has been on, I have sat in on meetings at large clients where they've pulled sites that are supposedly link farms (according to google) and put together an ad buy on behalf of competitors meant to cause these penalties to be levied and WMT messages to be sent.
- ryan-allen 12y agoSounds like a classic Bait and Switch, albeit a good 10 year long one on Google's behalf. They needed to provide a useful service to begin with to get the traction (good search algorithms for the web-that-is), but now that they are the incumbent, it is more in their interests to penalise website owners and force them to buy ads. It's sad, but it's normal monopolist behaviour.
- jayd16 12y agoNow you're talking about a malicious attack. If that's what it takes for this to be a real issue then I don't think many people need to be too concerned.
- aaronwall 12y agoThe cost of building a quality website & promoting it can easily hit deep into 6 or 7 figures. The cost of throwing scummy links at a website is under $100. And if their first $5, $10, or $20 test doesn't work? Then so what for them. They put it on cron job and throw another $20 at it again and again. http://www.seobook.com/images/sape-sape-sape.gif http://www.seobook.com/images/sape-sape-sape.gif The key point here is that there's a 100X or 1000X gap between 4 figures & 6 to 7 figures. The cost of burning things to a crisp is much lower than building them up. Whenever incentive structures have a 1000-fold difference in outcomes the path of least resistance becomes a popular path.
- EGreg 12y agoWhat Matt Cutts is saying, is that as collectively smart as his employer Google is, they aren't able to always figure out if a link is natural and when it's "paid for" as part of linkspam. If they could, they would obviously put that in their algorithm. Matt Cutts' job at Google involves him making tons of videos explaining how the Google algorithm works. It isn't omniscient, and the guidelines show how to work within its limitations. If you don't care about optimizing your Google presence (as we don't) then you shouldn't care about Google's guidelines either. But if you do comply with some guidelines, then this will probably help your rank in other search engines which also take similar measures to TRY and detect linkspam. Google's customers are its users. It tries hard to have the most relevant results (or provide value some other way, or just maintain a brand image so people keep coming back). The advertisers come because the users find them and spend real money. And the users want relevant search results, not spam. That's why Google spends a ton of resources on combating the spam. How do you propose they magically "know" when a link is natural?
- ForHackernews 12y ago> Google's customers are its users. No, Google's customers are its advertisers. They're the ones who pay money to Google. I agree with your general point though, the algorithm isn't perfect and sometimes it goofs. What I think people are having a negative reaction to is Matt Cutts' seemingly obtuse responses, as though he doesn't even understand the issue at hand (Google's actions distorting natural behavior), so he just keeps explaining the anti-spam policies in general terms. It's not a conversation, it's people talking past one another.
- freshhawk 12y agoThe icing on the cake is that Matt Cutts is obviously a very bright and very perceptive person so it's easy to assume that his not understanding is intentional. That would be right out of the PR/Politics "avoiding awkward questions 101" textbook but it's a scummy tactic.
- aaronwall 12y ago
- malandrew 12y agoIt seems like you are heading down the path where black hat anti-SEO on competitors becomes an increasingly viable business model. For example, company A competes with company B. They are cutt-throat so they pay a blackhat SEO firm to generate obviously spammy links for their competitor, not in an effort to bring up their own ranking, but to tank the ranking of their competitor relative to their own. At the end of the day, you do not know the intent of a link. Discounting a low quality link is reasonable. Penalizing the site it points to is not.
- Isofarro 12y agoThe victim site looks at where these newly created back links are coming from, and then reports them to the Google disavow tool and disavow the lot of them. That is the mechanism for dealing with the intent of those links. After a few cases like this, a long list of multiple disavowed domains/networks/fingerprints, where are these negative links going to come from? This anti-SEO tactic you outline can only be used a handful of times before it becomes useless.
- malandrew 12y agoSo now black hat SEO people have a tool where they can buy links and disavow the ones where they get caught?
- DerpDerpDerp 12y agoYour comments on this post are a great demonstration of the attitude that is driving me off Google properties, as quickly as I can find viable replacements.
- aaronwall 12y agoBest of luck staying off of Google properties. It gets more challenging by the day. http://mako.cc/copyrighteous/google-has-most-of-my-email-because-it-has-all-of-yours http://mako.cc/copyrighteous/google-has-most-of-my-email-bec... Don't like YouTube's copyright claim issues on video game playthroughs? Use Twitch. Oh wait, what's that? Google is trying to buy Twitch. http://kotaku.com/report-youtube-is-buying-twitch-for-1-billion-1578241076 http://kotaku.com/report-youtube-is-buying-twitch-for-1-bill... Oooops.
- RealGeek 12y agoSo in this scenario, my competitors can spam links for my website and put me into trouble. Google will notice that my website has some spammy links (which my competitor created), and then penalize me for it. Then I have to contact every website that links to me to ask them to remove links to my website... else their website would get penalized too. I get such emails every week. Rather than these fear mongering tactics, why can't Google just ignore spammy links instead of penalizing the whole websites and all the websites that link to them?
- rjzzleep 12y agoI didn't really like matts answers, some of them are not answers at all. But! You may have hit the nail on the head. if i had to guess i would say that storing exceptions means that suddenly the algorithm had to check part of the corpus for these exceptions. at the scale at which google operates this could probably lead to rather big size and speed implications. But maybe i'm just fantasizing.
- RealGeek 12y agoGoogle's algorithm already analyze if a link is useful or spam. They can simply ignore the links that are spam and count only good links. But, Google decides to punish the websites caught in the fire. If your website has a link Google does not like, Google can penalize your website along with all the websites that link to you or you link to them.
- aaronwall 12y agoWhen monopolies distort markets, the impact of those distortions have outsized impacts on the rest of the ecosystem. Ask Google engineers how they feel about centralization of power in telecom or finance or politics & they will tell you it is the worst thing ever http://www.youtube.com/watch?v=Ik1AK56FtVc http://www.youtube.com/watch?v=Ik1AK56FtVc Yet that same sort of centralization is fine when it is Google. Those same engineers will admit that any algorithm has some level of false positives & false negatives. They may try to minimize these, but they can't make them zero. The other thing which gets very little coverage, but is crucially important is that in spite of already having a monopoly market position Google keeps buying search marketshare with: their secret Android partner contracts, Firefox default search placement, iOS default search placement, Flash embedded into Chrome (so security updates happen in the background without sending you to a download site where trash can be bundled in with the update) & Flash security updates that hit all other web browsers coming bundled with Chrome bundleware which sets Chrome as your default browser, etc. If Google decides they don't like you (for any reason), then you need searchers to use a different search engine in a browser which isn't paid off by Google for default placement. And you need to hope that users are savvy enough to repeatedly say "no thank you" to the automatically bundled Chrome install with their frequent Flash updates. Google mentions how anything is only a click away or similar, but most people tend to use defaults. When someone changes those defaults on Chrome users, that's a horrible user experience & the "hijacked" settings must be reset. http://chrome.blogspot.com/2014/01/clean-up-your-hijacked-settings.html http://chrome.blogspot.com/2014/01/clean-up-your-hijacked-se... But when those defaults are paid for by Google or changed through Google bundleware it is "a great user experience." If Google believes their marketshare is a reflection of their superior search offering, they are welcome to stop buying default search placement in other web browsers & stop bundling Chrome installs on Flash security updates. But currently they are spending north of a billion Dollars a year on these activities, which indicates they clearly feel there is significant value to them.
- btown 12y agoIf manually disavowing a link truly has the same effect as getting it removed by contacting the third-party site's webmaster, then why would people still ask for links to be removed? Is disavowal somehow penalized, i.e. it reduces but does not eliminate the penalty induced if no action had been taken? Or is Google's line that the penalty would be eliminated, but people don't trust that Google's algorithms work the way it says they do, and still ask for the takedown to be safe?
- aaronwall 12y agoLinks which are nofollowed are still seen by users & can still impact that user's experience with the website. Yet those are fine, even if they point at spam, because they don't have a significant impact on Google. So then what's the difference between disavows and having the links removed? Getting the links removed costs far more time & money. And it gives Google a data mining stream of feedback they can leverage to dish out further penalties. Google requires some of the links to be removed not because it improves the web, but rather their goals & interests are aligned with punishment. They want to add cost & uncertainty to SEO in order to discourage investment in SEO from entities not formally connected to Google.
- Isofarro 12y ago> So then what's the difference between disavows and having the links removed? Getting the links removed costs far more time & money. And it gives Google a data mining stream of feedback they can leverage to dish out further penalties. That's a good thing right? Pushing sources of bad links down through the basement, effectively nuking the source/network from the link graph. You know Google's ranking system is based on information, and adding more information leads to better results for the Web user.
- aaronwall 12y ago>That's a good thing right?< That really depends on your perspective. If it were impossible for others to throw trashy links at your site in bulk for cheap it could perhaps be a good thing. If Google didn't change policies overnight & then retroactively penalize you for things which were fine in the past http://searchengineland.com/guest-post-google-penalty-187707 http://searchengineland.com/guest-post-google-penalty-187707 then it could perhaps be a good thing. Unfortunately, in reality, both of those ifs are hypothetical & untrue. Which means it is absolutely not a good thing. >You know Google's ranking system is based on information, and adding more information leads to better results for the Web user.< Quality of information matters as much as the volume of information. Look at Demand Media's current stock price for an example of this. But in terms of links, you have to think through the impacts here... Yes if Google freezes some activities they dislike then perhaps that is a net positive for relevancy, however the more they fear-monger about links the less natural linking goes on. Most of the major social sites put nofollow on almost all external links. And with the sea of fear approach to relevancy, in some cases magazines or newspapers will profile a person & not link to the source in spite of the entire article being about that source. I've spent many hours being cited by journalists where in spite of being good enough to be the primary source for their content, there was no link citation. paraphrasing David Naylor's excellent recent video http://youtu.be/UdflGrCJxYc?t=1m50s http://youtu.be/UdflGrCJxYc?t=1m50s "More and more high profile websites are having a no linking policy. Which really is kind of weird isn't it, because if that is a journalistic website and they are writing about your website surely those are the kinds of links Google would want to see. ... It seems kind of weird that the links Google actually wants you to get are the first links to dry up on the web." - David Naylor The other important factor is the quality of the information created by those who are trying to do disavows and link removals. When people are irrationally driven by fear while in a harmed state, they are NOT acting rationally. Business owners who are selling off assets, firing employees, stalling with creditors, aligning predatory lending to try to keep things afloat, etc. are stressed out & are likely to make many poor decisions in that rushed & panicked state. Thus some of that more information which is created is junk misinformation. Consider this email: http://www.seobook.com/images/link-unremoval.png http://www.seobook.com/images/link-unremoval.png They asked the website to remove the link claiming it was unnatural, and then they emailed again to ask the website to ignore the removal request. They don't know which links are "unnatural" and so they are using automation to try to sort through it all. Are their automated quick guesses (which are often driven by tools) more useful than all of Google's internal reviews & ratings data which has been built up for over a decade? Color me skeptical. There's another factor with the disavow data as well. Look at this removal request http://www.seobook.com/images/trampolines.png http://www.seobook.com/images/trampolines.png Our site has about 20,000 unique linking domains referencing it. However over the years we have had well over a million registered user profiles. If only 2% of the registered user profiles were ignorant spammers who spammed our profile pages and then later added our site to a disavow file, we would have more people voting against our site than we have voting for it. And those profile pages were already not indexed & the links were nofollowed anyhow. Those pages are effectively outside the search game, yet those ignorant spammers can still create negative votes against our site based on the fear-mongering. And as bad as that sounds, there's no reward for actually removing the bad links either. At some SEO conferences numerous SEO experts have gave the advice to "just disavow them anyhow" even if the links are removed. Thus this deluge of email spam offers publishers no value whatsoever, just sunk cost & wasted time - time which could have been spent creating useful information.
- RealGeek 12y agoIf my website is getting spammy links, which I did not create. Additionally, it is out of my control to create / edit / remove those links. In such scenario, how does Google determines if I created the links? Does Google have precognitive abilities or it can spy on my communication channels (Gmail, Google Voice, Hangouts etc.) to figure out if I am innocent?
- Isofarro 12y agoThat's where the Google disavow links tool comes in: https://www.google.com/webmasters/tools/disavow-links-main?pli=1 https://www.google.com/webmasters/tools/disavow-links-main?p... A model is only as good as the information in it. In this case providing details of these spammy links helps you, and every other site targeted through the same sites/networks/fingerprints. Consider it a reverse no-follow mechanism.