I would suggest keeping it simple and scripting wget instead: https://www.gnu.org/software/wget/manual/html_node/Following-Links.html https://www.gnu.org/softwa

I would suggest keeping it simple and scripting wget instead: https://www.gnu.org/software/wget/manual/html_node/Following-Links.html https://www.gnu.org/software/wget/manual/html_node/Following... Often all that is needed is -r --no-parent