2 ms·
Some of this is a little dated - for example there's not much point in managing a crawler yourself when you can just pay alexa to do it for you. I still found
by abstractbill 20y ago
Some of this is a little dated - for example there's not much point in managing a crawler yourself when you can just pay alexa to do it for you.
I still found a few useful tips though.
- python_kiss 20y agoThe article is meant to be taken as a general guide. The author does suggest that we use a pre-programmed crawler rather than code one ourselves. Refer to this passage: "Crawler. If you don't use an open source crawler, my advice is a super-simple multistep crawler. This is very important advice that will cut months off your development time, so if you ignore everything else, don't ignore this."