2 ms·
Scraping seems rude, although I might try a gentle scrape if PG doesn't complain... so far, afaik, he's been silent on the topic in re to news.YC...
by andreyf 19y ago
Scraping seems rude, although I might try a gentle scrape if PG doesn't complain... so far, afaik, he's been silent on the topic in re to news.YC...
- Tichy 19y agoI don't think there is a robots.txt, and I remember comments that crawling HN is OK, at a reasonable rate.