3 ms·

They are accessible over HTTP. http://git.savannah.gnu.org/cgit/nano.git/commit/?id=115aeda69b6f45271b8d4f7a10dcf5261714b30c http://git.savannah.gnu.org/cgit/na

• infodroid 10y ago
  I did not know that about Savannah. I am mainly familiar with Github, Bitbucket and Launchpad. I guess there is no point hiding from the bots these days.
  • deleted 10y ago
    [deleted]
• tzs 10y ago
  They are more accessible here on HN, though, because crawlers that obey robots.txt will not see it on git.savannah.gnu.org but will see it here on HN.
  • yellowapple 10y ago
    I suspect that if a crawler is being used to farm email addresses for spamming, it's highly unlikely that robots.txt would be any deterrent whatsoever.
    • mysidia1 10y ago
      Spammers' crawlers use URLs obtained from search engines and public sources. If the whole directory is blocked in robots.txt, it WILL reduce crawling activity massively.