2 ms·The crawler portion is about as sophisticated as `wget -R`.by fizx 12y agoThe crawler portion is about as sophisticated as `wget -R`.