4 ms·
Don't worry, you didn't slow down the server. I throttled your IP address. The server can withstand a crawler or two. The reason I ask people not to crawl th
by pg 18y ago
Don't worry, you didn't slow down the server. I throttled your IP address. The server can withstand a crawler or two. The reason I ask people not to crawl the site is simply that if I let one person do it, I have to let everyone, and considering the audience here, that might mean we'd have 100 of them.
- spiralhead 18y agothe real question here, I think, is do you really have any legal recourse to stop us (not just being provocative, I actually wonder)?
- kylec 18y agoWhy not create periodic dumps of the database and allow people to glean interesting statistical data from it? You could remove any non-public information (passwords, preferences, individual up/down voting, last 2 octets of the IP, etc). It would be interesting to see what hours and what days people are active, where the visitors are coming from, what the most common words used are, etc.
- boredguy8 18y agoLike http://news.ycombinator.com/item?id=172701 http://news.ycombinator.com/item?id=172701 http://news.ycombinator.com/item?id=182374 http://news.ycombinator.com/item?id=182374 http://news.ycombinator.com/item?id=197644 http://news.ycombinator.com/item?id=197644 http://news.ycombinator.com/item?id=212491 http://news.ycombinator.com/item?id=212491 http://news.ycombinator.com/item?id=213891 http://news.ycombinator.com/item?id=213891 ? http://news.ycombinator.com/item?id=218782 http://news.ycombinator.com/item?id=218782
- trevelyan 18y agoMaybe because it's too much work.
- maxklein 18y agoHow did you discover it that quickly then? Do you have some type of server monitoring tool?
- pg 18y agoThere are a bunch of (mostly primitive) ways to watch what's going on. I didn't notice it all that quickly, though.