3 ms·
HN is very, very slow. Removing crawlers likely helps with that.
by pvg 17y ago
HN is very, very slow. Removing crawlers likely helps with that.
- tjic 17y agoRemoving a leg or two could also help one towards a weight loss goal.
- dmoney 17y agoBut then you lose a lot of options for exercise. Walking and running are definitely out.
- lsc 17y agoI would bet good money that it's nothing that a good dedicated server with, say, 32GiB ram and 2 or 4 sas spindles couldn't fix.
- pjhyett 17y agoYou can set gbot's crawler rate with google webmaster tools if that's the issue.