3 ms·
Did you ask for permission to crawl news.yc? (see http://news.ycombinator.com/item?id=271119 http://news.ycombinator.com/item?id=271119)
by soundsop 18y ago
Did you ask for permission to crawl news.yc? (see http://news.ycombinator.com/item?id=271119 http://news.ycombinator.com/item?id=271119)
- deleted 18y ago[deleted]
- twism 18y agono i did not. I'm not crawling the entire site, just enough to get the data that is needed. I think the app would still work if my ip was throttled anyways, albeit new items would show up on feeds later (but the app response time would be quicker).