True, I guess that's the advantage of HTTrack. I guess for my use case, it would be better to get the parsing that HTTrack does, get all the url's, and pass th

True, I guess that's the advantage of HTTrack. I guess for my use case, it would be better to get the parsing that HTTrack does, get all the url's, and pass that into an intelligence to selectively grab files.