4 ms·
It's possible to download the entirety of Wikipedia: it's only 100 GB?
- bhaney 3y agoIf you only want the current text of English wikipedia, the dump is 22GB compressed (no images, history, talk pages, or other languages) [1] Wikipedia also publishes an index file with that compressed dump, which allows you to extract only a portion of the compressed archive to get the article you want without ever needing to decompress the entire dump. [2] Thanks for reminding me to update my copy. [1] https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles-multistream.xml.bz2 https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-page... [2] https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles-multistream-index.txt.bz2 https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-page...
- lantry 3y agoAlso available via torrent https://meta.m.wikimedia.org/wiki/Data_dump_torrents https://meta.m.wikimedia.org/wiki/Data_dump_torrents