4 ms·
I'm using wget for a project, basically because it's the only crawler on the planet that given a single URL, can download that page + all images, style sheets a
by pooriaazimi 15y ago
I'm using wget for a project, basically because it's the only crawler on the planet that given a single URL, can download that page + all images, style sheets and scripts embedded in it without hassle (just with a flag: -p or --page-requisites).
It sucks however, because you can't redirect its output to another program and have to write the output to the file system (more I/O).