4 ms·
> I have considered locally copying wikipedia but given up after the effort that might be required. Anyone got any experience or tips? Try the wget command lin
by waterhouse 14y ago
> I have considered locally copying wikipedia but given up after the effort that might be required. Anyone got any experience or tips?
Try the wget command line tool; it's generally useful for site-mirroring. "wget --mirror" will recursively download an entire website; if it is impractical to download all of Wikipedia, you may test with the option "-l <recursion depth limit>" to get only a part; then "-p" will make it get all images and whatever needed to display the pages in question. And if you want to only get the text pages/reject the images, the "-A" and/or "-R" options may be useful. Consult the man page and experiment.
- damncabbage 14y agoPlease don't do this; Wikipedia provides dumps for exactly this purpose: http://en.wikipedia.org/wiki/Wikipedia:Database_download#English-language_Wikipedia http://en.wikipedia.org/wiki/Wikipedia:Database_download#Eng... (Further explanation regarding the use of robots, spiders and 'wget -m' here: http://en.wikipedia.org/wiki/Wikipedia:Database_download#Please_do_not_use_a_web_crawler http://en.wikipedia.org/wiki/Wikipedia:Database_download#Ple... )