3 ms·
You should probably put this in your robots.txt file: User-agent: * Disallow: / Wouldn't want other pesky search engines like Google or Yahoo stealing you
by tdavis 18y ago
You should probably put this in your robots.txt file:
User-agent: *
Disallow: /
Wouldn't want other pesky search engines like Google or Yahoo stealing your genius comments for their sole gain, too. Wait, Backtype, are you going to steal this comment?! Quickly! I must change HN's robots.txt file!
Asinine