3 ms·

Not that hard? You'd need to process each page then data mine it.

• eof 7y ago
  A company that can build a game engine should probably be able to crawl a site and save an html dump?
• biggestdecision 7y ago
  Just archive.org every page on the wiki. Their api will let you do 15/minute.
• smacktoward 7y ago
  HTTrack (https://www.httrack.com/ https://www.httrack.com/) makes tasks like this trivial.
  • imtringued 7y ago
    It doesn't run a full browser engine so it won't work with the vast majority of websites.