4 ms·

From reddit.com: User-Agent: bender Disallow: /my_shiny_metal_ass User-Agent: Gort Disallow: /earth

• Boldewyn 14y ago
  Better still: http://www.last.fm/robots.txt http://www.last.fm/robots.txt Disallow: /harming/humans Disallow: /ignoring/human/orders Disallow: /harm/to/self
  • hiddenfeatures 14y ago
    OMFG. That is hilarious! Made my day
  • anonymous 14y ago
    Brilliant!