4 ms·
Correct, there are no images in the data except for 68 PNGs. It's just HTML files.
by mhx77 2y ago
Correct, there are no images in the data except for 68 PNGs. It's just HTML files.
- nextaccountic 2y agohow it's possible that a bunch of html files would add up to 200gb? is it because of some kind of overhead? would maybe a database dump be smaller?
- hifromwork 2y agoWell, "a bunch" is an understatement, I bet they have a bit more than just a bunch! It does pass a sniff test, since from https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia: >As of May 2015, the current version of the English Wikipedia article / template / redirect text was about 51 GB uncompressed in XML format. Compressed data at the same time was 11.5 GB. And that's data from 9 years ago, and just English Wikipedia. For comparison, I collect leaked password dumps and they (combined, after deduplication) go into hundreds of GBs too. And that's for just username:password lines, not even text.