4 ms·
That's not a legitimate reason to ban google. You can always (using google's webmaster tools) throttle their indexing. Or you can use search-engine specific lin
by keltex 17y ago
That's not a legitimate reason to ban google. You can always (using google's webmaster tools) throttle their indexing. Or you can use search-engine specific lines in robots.txt (Bing anyone?) to ban misbehaving bots.
The only reason to do this is if you don't want your site indexed by google. Which I really can't think of a legitimate reason to do so.
- andrewcooke 17y agotrue, but it's a busy time for yc. maybe this was just a stop-gap measure? when did it start?
- deleted 17y ago[deleted]
- jonknee 17y ago... And you can speed the site up. There's no reason HN has to be so slow.