4 ms·

wrt robots.txt, what is the incentive for site owners to prevent duplicate submissions? As a site owner, wouldn't I be happy if both http://www.myadsenseblog.co

• joshwa 18y ago
  * makes it easier to track if your content has gone viral or not * votes aren't split across multiple copies: a few votes here, a few there, and maybe you could have made the front page * users are less pissed off (looking at you, nytimes and bbc)