3 ms·
The title is misleading. It should be "Lessons learned about web crawlers while crawling the web"
by alecsmart1 13y ago
The title is misleading. It should be "Lessons learned about web crawlers while crawling the web"
- jgmmo 13y agoI think it should be called 'web scraping 101' Very thin article.
- billrobertson42 13y agoI found certain aspects of it really interesting. In particular, the way that the author interacts with the crawling software to gain insight into the structure of a website. Not just the process, but the way he interacts with it is interesting too.