3 ms·
Lessons Learned While Crawling the Web
- alecsmart1 13y agoThe title is misleading. It should be "Lessons learned about web crawlers while crawling the web"
- jgmmo 13y agoI think it should be called 'web scraping 101' Very thin article.
- billrobertson42 13y agoI found certain aspects of it really interesting. In particular, the way that the author interacts with the crawling software to gain insight into the structure of a website. Not just the process, but the way he interacts with it is interesting too.