6 ms·
What really ticks me off are all these sites clearly scraping content from Stack Overflow that somehow end up near the top of the search results. How is there
by pupppet 4y ago
What really ticks me off are all these sites clearly scraping content from Stack Overflow that somehow end up near the top of the search results. How is there not an automated fix for this. Lemme help you out with this Googlers: If site content A == site content B, pagerank = -1.
- tintor 4y agoUsing that rule it would be very easy to derank any website.
- boxed 4y agoNot if the list of A sites was manually curated. Like stackoverflow and wikipedia. This isn't hard for shooting down a ton of sites.
- ericpauley 4y agoThen people could derank sites by copying them to stack overflow.
- plantain 4y agoSo both sites lose? That'll make manipulation easier than ever before. Or does the older site win? Frequently scraped / already popular sites will love that.
- pupppet 4y agoDerank the newer page, you don't need to derank the entire site.
- nojs 4y agoThis doesn’t work in general because people can copy content faster than google can check who was first. Also sometimes you actually want the derivative.
- carewell 4y agoLet’s start with big offenders. If a website copied tens of thousands of comments from SO it gets penalized. We don’t always need to find a perfect system to improve our experience.
- BugsJustFindMe 4y agoIt kinda sounds like you think that Google doesn't have the resources to have a human decide that stackoverflow isn't itself a spam clone. This is a huge problem for a very small number of sites and a non-existent problem for everything else. The list of authoritative, egregiously-copied sources could easily be maintained by one person. The only difficulty comes from determining when to trigger the system.
- nikanj 4y agoThey have the resources, they don’t have the willingness. Google’s MO is never hiring a human to do a job well, when a computer can do the same job badly.
- UncleMeat 4y agoCue a HN post “wtf google, my archive website is getting marked as spam.”
- pupppet 4y agoI don't want your archive website near the top of my search results when the original is readily accessible.
- UncleMeat 4y agoWon't stop the outrage post.
- Fatnino 4y agoThe actual outrage should be when a small site posts something and then that content gets stolen and posted verbatim as an answer on stackoverflow. There's even the possibility that the Google crawler will have seen the SO page before discovering the original small site.
- carewell 4y agoThe suggestion is not to penalize all websites that share some minor amount of content with SO but to remove websites that copy tens of thousands of comments from SO and do not provide any other value. It’s a pretty easy to identify and implement this distinction.
- _cs2017_ 4y agoYou have any examples of that? Sounds far-fetched to me, since SO posts: (a) are in response to very specific questions (b) can be easily reported to SO for plagiarism (c) make no $$ for the poster, reducing the incentive to plagiarize
- mynameisvlad 4y agoYou misunderstand the parent comment. They’re saying there are full sites which just scrape SO content. These are not hosted in StackExchange and therefore are not subject to their reporting system, and generally are filled with ads which provide the money and therefore incentive.
- levymetal 4y agoThese can be hidden using uBlock origin. I’ve got a list you can import (just use the raw link). The selector isn’t perfect in Google (sometimes leaves some unattached content) but the link is always removed. Feel free to submit a PR if you find any other SO clones - there seems to be no end to them. https://github.com/levymetal/filter-lists/blob/main/filters/stackoverflow-clones.txt https://github.com/levymetal/filter-lists/blob/main/filters/...
- carewell 4y agoThanks! I didn’t realize uBlock can remove specific domains from Google search, but looking at filter definitions it makes sense.
- paulpauper 4y agobuuh bye Investopedia
- smnrchrds 4y agoIs Investopedia a clone? What is the original?
- kevin_thibedeau 4y agoThey have a fix already and applied it to the Wikipedia clones. They intentionally ignore other content scrapers because they drive ad impressions.
- bombolo 4y agoI wish google had a feature to permanently ban domains from search results.
- prolyxis 4y agoThere are browser add-ons that can do this (for example, uBlacklist).
- vorpalhex 4y agoKagi has that feature.
- kdot 4y agoThey had a personal block list at one point... but removed it.
- lazyeye 4y agoThere is a chrome addon called uBlacklist that auto-hides domains (configurable) in the google search results.
- vouaobrasil 4y agoWhy not just create your own search box and put -site:domain.xyz in the query? Maybe there is a length limit but at least you can ban some
- vborovikov 4y agothis list is really helpful https://github.com/quenhus/uBlock-Origin-dev-filter https://github.com/quenhus/uBlock-Origin-dev-filter
- _cs2017_ 4y ago> because they drive ad impressions. Could you explain why? If Google replaces SEO trash with decent results, the ads they will show on the Search page will remain unchanged. How would the impressions suffer? Or rather, since Google charges per click not per impression for search ads, how would ad clicks suffer? In fact, I thought low-quality organic search results are purely a negative for Google profits, since users (over a very long run) move their search elsewhere (Tiktok, Reddit, etc.).