5 ms·
>79GB for all of the English articles minus the media. I think thats an error on the github, wikipedia_en_all_novid is all text + pictures, just no videos. Tex
by rasz 7y ago
>79GB for all of the English articles minus the media.
I think thats an error on the github, wikipedia_en_all_novid is all text + pictures, just no videos. Text alone is ~15GB zipped. My 2014 Media dump was ~76GB, so that 80GB for full text+media checks out.
- nikisweeting 7y agoDoes wikipedia_en_all_novid really include pictures? Wouldn't that be many hundreds of GB?
- walrus01 7y agoI think just the pictures which are embedded in pages, not all media assets.
- nikisweeting 7y agoStill, that seems way too small to me considering there are ~6m articles.
- nikisweeting 7y agoApparently I was wrong! They got it super small. [ ] wikipedia_en_all_mini_2019-09.zim 2019-09-18 03:16 10G [ ] wikipedia_en_all_nopic_2018-09.zim 2018-09-26 16:43 35G [ ] wikipedia_en_all_novid_2018-06.zim 2018-07-18 21:21 77G [ ] wikipedia_en_all_novid_2018-10.zim 2018-11-06 12:43 78G
- rasz 7y agoFrom what I gathered ZIM picture library is re compressed for lower quality/size.