4 ms·
I think screen scrapping is not allowed by HN. Few tries with these APIs might get your IP banned!
by Sharma 13y ago
I think screen scrapping is not allowed by HN. Few tries with these APIs might get your IP banned!
- sprizzle 13y agoThe robots.txt file doesn't seem to disallow scraping. https://news.ycombinator.com/robots.txt https://news.ycombinator.com/robots.txt
- karangoeluw 13y agoScraping the listing pages seems allowed though.
- scott_s 13y agoI don't think there's a prohibition to screen scraping, but if you make too many requests to the server in a certain amount of time, your IP will be banned to prevent the server from melting.
- EugeneOZ 13y agoAgree. Also HN have RSS.