3 ms·
Recently I've noticed that the GitHub and Stack Overflow scraper clones will often be the only result for this kind of query. It looks like the blackhats have f
by ghughes 5y ago
Recently I've noticed that the GitHub and Stack Overflow scraper clones will often be the only result for this kind of query. It looks like the blackhats have found a way to rank higher then the content they're cloning. I suspect this has the side effect of tricking Google's anti-spam system into punishing the canonical domains and URLs, because it thinks they're copies of higher ranked content.
- throwthere 5y agoI never peaked at the gh source but from using it I think you only see closed issues after hitting a select box or button. Maybe googlebot isn’t “doing” that, triggering the JS or whatever drives it.
- shadowgovt 5y agoThis one is an open issue.
- CSDude 5y agoStackoverflow does not even need scraper, themselves publish a dump.
- hobs 5y agoAh, but that's quarterly at best :)
- BugsJustFindMe 5y agoIt seems to me that the first-page prevalence of scummy clone sites can only be explained by either extreme ineptness or profit-driven malice from google. It's not like google's search engineers have never heard about this problem.