3 ms·
It's not as simple as saying "deindex anything that has optimized title tags or lots of links or shows adsense" No, it's not. But undoubtedly, SEO spammers ar
by stcredzero 16y ago
It's not as simple as saying "deindex anything that has optimized title tags or lots of links or shows adsense"
No, it's not. But undoubtedly, SEO spammers are leaving behind the same kind of clues that email spammers do. Using techniques like Bayesian classifiers should be able to classify such pages. Just detecting all the pages that are slightly edited/SEO-optimized stackoverflow answers would be a good start for me.
you'd likely also reduce the number of useful sites in the results because you're specifically targeting and removing the sites that optimise for search engines, which is 99% of the most successful sites on the web today.
I'd be putting useful sites in the "useful" corpus.
SEO is not an inherently bad thing, it's valueless, spammy content that's bad.
Agreed, just as email marketing is not an inherently bad thing, just spammy emails.
http://xkcd.com/810/ http://xkcd.com/810/
- phpnode 16y agoThere are billions and billions of pages in the index, let's say they produce a page classifier that can correctly identify spam an unrealistic 99% of the time. They'd still misidentify tens of millions of pages. Regarding your second point, how do you determine usefulness in a way that can't be gamed? My point is, this is a very, very, very hard problem to solve at their scale, a lot of posters on here are trivialising it.
- stcredzero 16y ago99% classifier? So I get to have a search that's like Google/Bing for all the non-spammy searches, and it only gets 1/100th the spam for the spammy searches? I think I could sell a proposition like that!