6 ms·
Encarta was an amazing product that I fondly remember using in school. It was essentially wikipedia before there was wikipedia with the upside that it had curat
by kenty 6y ago
Encarta was an amazing product that I fondly remember using in school. It was essentially wikipedia before there was wikipedia with the upside that it had curated and citable sources and generally a much higher quality of writing.
In my eyes, over the years, wikipedia has caught up a lot in terms of quality of writing and wikimedia now has a lot of images and video.
I wonder if there is a way to just download the whole wikipedia for easy distribution like encarta.
- deleted 6y ago[deleted]
- jxf 6y agoPart of the value of Encarta was in the human curation of what was interesting. Wikipedia includes (by necessity) everything — but an encyclopedia would probably devote more space to (say) Nigerian history than to (say) the in-game statistics of all ~1,000 Pokémon.
- p1necone 6y agoI suspect the sort of person who writes Wikipedia articles about Pokemon would not go and write articles about Nigerian history instead if Pokemon articles were not allowed, and vice versa. Wikipedia contributions are not really a zero sum game.
- patrec 6y agoWell, for storage (and thus offline) purposes it is of course exactly a zero sum game. I for one would really like a say 3 GiB version of English Wikipedia without Pokemon and Porn, or a 33GiB version with useful images. However broad and non-deltionist might be best for online Wikepedia, a more curated i.e. deletionist version would certainly be very useful for offline usage and quite a few other purposes.
- exDM69 6y ago> I for one would really like a say 3 GiB version of English Wikipedia without Pokemon and Porn, or a 33GiB version with useful images. There are several offline snapshots of different sizes of Wikipedia that do exactly this. Some of them are more thoroughly curated, others are a snapshot of the most popular articles, etc. What I could not find easily was a full English Wikipedia with images and all available in an easily accessible format (like the Kiwix snapshots). I'd put a whole hard disk for this purpose, because the size is in the gigabyte-terabyte range.
- asah 6y agoSome relevant links: 100,000 curated pages: https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level/5 https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level... In terms of space, the text is over 1000x smaller than the multimedia: ~20GB (uncompressed) for the text vs ~45TB (compressed) for multimedia (est accounting for growth vs 23TB@2014). https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia
- monort 6y agoWhat's wrong with kiwix snapshot of English wikipedia? It's only 93GB. http://download.kiwix.org/zim/wikipedia/wikipedia_en_all_maxi_2020-09.zim http://download.kiwix.org/zim/wikipedia/wikipedia_en_all_max...
- patrec 6y agoWell, I was hoping for less than 93GiB compressed, given that this exceeds the storage capacity of several devices I'd like to use it on and I'd estimate the total amount of info I care about to be far smaller than that. And small is beautiful: if everything fits into ram, you can do various interesting data munging tasks on the data (which is after all not uninteresting) very quickly.
- patrec 6y agoI am aware that there are various offline wikipedia compilations and I am grateful they exist and to the people who work on them, but last I looked using them looked like a bit of pain, and on checking again that still appears to be the case. I get the impression that if I want to have something of decent quality that fits into the 10s of GiB range I'd consider reasonable¹, I'd have to manually munge together several non-Pokemon topics I consider important plus one of the text only dumps. This would be more palatable if I had a strong impression that once I hit upon a working process I could rinse-and-repeat on a yearly basis. Do you have any experience with this? ¹E.g. the 100k top article page linked by sibling does not look super promising, ~700 math articles vs ~10k fluff (sports, entertainment etc.).
- quietbritishjim 6y agoI think the point was that if you are looking at a subject where the relative importance is less obvious than Pokemon vs Nigerian politics then you could gauge importance implicitly from the existence of the article in a curated encyclopedia - not that contributers should be forced to spend more time on more important topics.
- mekkkkkk 6y agoIf they were employed to do so, they would. A curated encyclopedia with paid researchers would not be bound by the whims of weebs.
- 29athrowaway 6y agoSome people call this phenomenon "wikigroaning": "the art of highlighting Wikipedia's bias toward things that don't matter". https://en.wikipedia.org/wiki/Wikigroaning https://en.wikipedia.org/wiki/Wikigroaning https://www.somethingawful.com/news/wikigroaning/ https://www.somethingawful.com/news/wikigroaning/
- wishysgb 6y agoI just don't get why doesn't it matter . for what it is Pokemon is a game and in some ways a form of art, and since many humans are interested in it deeply that means that it is important to them. I think it is important human knowledge, there is no need to be elitest about it.
- 29athrowaway 6y agoSome pokemons are inspired in real world animals. Many people know the pokemon and not the animal. They know about drowzee but not about the tapir.
- Cthulhu_ 6y agoAnd yet there's a ton of information that is rejected from Wikipedia itself, which found a place on e.g. Wikia and a few other sites like that - mainly about gaming, but also about subjects like D&D, etc.
- musicale 6y agoIf Bulbasaur is on Wikipedia, then Owlbear should be also. ;-) https://en.wikipedia.org/wiki/Owlbear https://en.wikipedia.org/wiki/Owlbear
- ben_w 6y agoI remember a similar comparison with Tony Blair back when he was the Prime Minister of the UK; the response was that while Wikipedia did indeed say more about Pikachu than Blair, Wikipedia also said more about Blair than did whichever “proper” encyclopaedia Wikipedia was being compared with at the time.
- musicale 6y agoWell, Pikachu has been a highly influential Pokémon for nearly 30 years.
- MaxBarraclough 6y agoI recall reading that there was a time the Wikipedia article on the lightsaber was longer than the article on the printing press. No longer the case, thankfully.
- JeanFred 6y agoCheck out Kiwix: https://www.kiwix.org/ https://www.kiwix.org/ “Kiwix is an offline reader for online content like Wikipedia, Project Gutenberg, or TED Talks. It makes knowledge available to people with no or limited internet access. The software as well as the content is free to use for anyone.”
- oriesdan 6y agoIndeed, Kiwix is the proper solution for anyone who cares about knowledge access in places where internet connection is spotty. Given the file format it uses (zim) is compressed, and meant to be accessed compressed to pluck a specific article, you can have all the content of English's wikipedia without images and videos in just 36GB. Plus, the specs of the file format are published and it's easy to build your own implementation, I did it for my needs. It's also great for privacy maximalists : I have wikipedia, wikisource and wiktionary in two languages locally, which means that most of my searches never leave my computer. Kiwix/openzim don't provide only mediawiki projects either, I've recently downloaded stackoverflow's content (although, I'll need to build a dedicated search engine for it to be really usable). You can have a look at the incredible amount of available content there: https://wiki.kiwix.org/wiki/Content_in_all_languages https://wiki.kiwix.org/wiki/Content_in_all_languages
- read_if_gay_ 6y ago> all the content of English's wikipedia without images and videos in just 36GB 36GB seems like a really big number if it's just text. A cursory Google search says 1MB will hold about 500 pages of text (ignoring compression). So 36GB would be something like 18 million pages? Let's say a 1000 page book is 10cm wide, so 18M pages wind up as 1800 meters of books, or 180 meter-wide bookshelves with 10 shelves each, which is maybe a large library? It seems like a lot of that must be external sources. I wonder what percentage was actually written by Wikipedia editors?
- indy 6y agoI'd assume that figure would also include the indexes required for searching
- bllguo 6y agothere are many ways to download wikipedia: https://en.wikipedia.org/wiki/Wikipedia:Database_download https://en.wikipedia.org/wiki/Wikipedia:Database_download
- elboru 6y agoIt also included great multimedia (images, audio, video, animations). I remember myself spending hours watching all kinds of physics animations.
- aimor 6y agoIn 2015 I was curious about the article distribution on Wikipedia so I scraped and visualized some data. At the time I was frustrated by the writing quality and I wanted to know how much of Wikipedia was 'quality' and how many of the 5 million articles were in subjects comparable to a general encyclopedia volume. My images are here: https://imgcdn.dev/i/c6fJ8 https://imgcdn.dev/i/c6fJ8 https://imgcdn.dev/i/c6VRy https://imgcdn.dev/i/c6VRy https://imgcdn.dev/i/c6Wn2 https://imgcdn.dev/i/c6Wn2 and you can compare that to some Wikipedia hosted comparisons: https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia#/media/File:Size_of_English_Wikipedia_(1000_vol).svg https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia#/m... https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia