3 ms·Turns out that wget is still great for spidering.by sleepybrett 2y agoTurns out that wget is still great for spidering.