3 ms·
There's also a lot of fun robots.txt. I forget where it was mentioned (I didn't find it myself) but this one always made me laugh: # robots.txt for http://
by nwh 14y ago
There's also a lot of fun robots.txt. I forget where it was mentioned (I didn't find it myself) but this one always made me laugh:
# robots.txt for http://www.palm.com/ modified 7/28/09
User-agent: Vampires
Disallow: /neck
- buttscicles 14y agoFrom reddit.com: User-Agent: bender Disallow: /my_shiny_metal_ass User-Agent: Gort Disallow: /earth
- Boldewyn 14y agoBetter still: http://www.last.fm/robots.txt http://www.last.fm/robots.txt Disallow: /harming/humans Disallow: /ignoring/human/orders Disallow: /harm/to/self
- hiddenfeatures 14y agoOMFG. That is hilarious! Made my day
- anonymous 14y agoBrilliant!