2 ms·
Any particular libraries or techniques you used for the crawling / parsing, or just coded up something from scratch for each site you crawl? (I think I noticed
by mistermann 16y ago
Any particular libraries or techniques you used for the crawling / parsing, or just coded up something from scratch for each site you crawl? (I think I noticed you even do kijiji.)
- ericd 16y agoAll of it is from scratch. Yep, I do Kijiji, but only in Canada, because I was told it's more important than CL in some parts there.