4 ms·

Try the recursive options of wget. It should be pretty much what you are talking about.

• Artlav 10y ago
  Huh, i was going to say that wget won't fix the links in the downloaded files, but turns out they thought of it too. Nice, that means the tool does exist already.
  • newman8r 10y ago
    Check my response above, feedback appreciated. downloading entire websites via wget isn't what I was getting at although that type of tech is certainly something that would be integrated into the hypothetical system. What I am thinking of would really go beyond what you could achieve with wget. No doubt offline browsing and personal crawlers have been around for a while. Think of a 10TB+ tivo-like device that comes pre loaded with everything from wikipedia to musicBrainz. People would't need to figure out what to download, it would already be there, and they could augment it with anything. Just a thought - I am going to keep looking into it and will create a public repo for it if it makes sense.