7 ms·
Volunteer for Kiwix here (https://kiwix.org https://kiwix.org), we do a lot of offline Wikipedia stuff. I've personally worked on MWOffliner (https://github.com
by audiodude 1y ago
Volunteer for Kiwix here (https://kiwix.org https://kiwix.org), we do a lot of offline Wikipedia stuff. I've personally worked on MWOffliner (https://github.com/openzim/mwoffliner https://github.com/openzim/mwoffliner) which scrapes MediaWikis, primarily Wikipedia.
We have apps for basically every platform. Our PWA even supports IE 11!
You can use the WP1 tool which I'm the primary maintainer of (https://wp1.openzim.org/#/selections/user https://wp1.openzim.org/#/selections/user) to create "selections" which let you have your own custom version of Wikipedia, using categories that you define, WikiProjects, or even custom SPARQL queries.
- freedomben 1y agoNeat, thanks! I'm CTO of Ameelio (non-profit) and have been eyeing Kiwix for awhile. Getting content to incarcerated people is a unique challenge due to the exceptional security requirements, and an offline solution like kiwix might fit in well. Being able to narrow down categories is a huge capability for us. Thank you!
- gehwartzen 1y agoJust wanted to comment on what a great mission Ameelio seems to have! Glad you guys are helping some of the most unseen in our society. Kudos!
- benoitberaud 1y agoFeel free to reach to us (Kiwix), we've already helped NGO deploy our content to prisons for the exact reason you mention.
- freedomben 1y agoNeat, thanks! I'll definitely do that :-)
- strofocles 1y agoMay I suggest somebody out of your company reviews the website. It is not clear to me what you do, what the apps do and so on. The copy is also kind of abstract "we make the world a better place" type of copy. From your comment I understand you do good work and would be a shame for people new to your products to struggle understanding what are you doing.
- bcraven 1y agoI don't agree with your assessment. Did you find the 'About Us' page insufficient?
- blazerunner 1y agoI don't think the previous comment was trying to be snarky - I can see where they're coming from. Take my feedback with a grain of salt, as I am entirely not the target audience, but... "Stay Connected, Always" - weird way to put it, given it's for offline situations. At this stage it sounds like it could be a 4G or portable wifi solution? "Use our apps for offline content or the Kiwix Hotspot for reliable access." - so it's probably a desktop or mobile app, maybe a web app. What is Kiwix Hotspot, another app? Unclear there is a hardware at this point, or any on the home page unless I watch the video that hints at it. The summary in the footer was a lot clearer to me: "Kiwix is an offline reader for online content like Wikipedia, Project Gutenberg, or TED Talks. It makes knowledge available to people with no or limited internet access" Again, not trying to complain for the sake of it, I think this is a cool project helping under-served communities, but if people can't easily understand what you do, they may not dig deeper. If I can't tell what is being offered without much thinking or digging, the home page isn't doing as much as it could be. Perhaps it is ticking the boxes for your target audience if you have done some testing. Great! If not, some quick user testing could help optimise the messaging to make sure what you offer is landing.
- eru 1y agoThe quote from the footer sounds pretty good. That should probably be front and centre.
- yreg 1y agoRegarding mwoffliner: Why scrape Wikipedia when you can just download a dump?
- dal 1y agoI was thinking the same. It must take much less space in database form than all the html pages.
- josephg 1y agoIts also kind of bad form to scrape a huge website when there's a downloadable dump available. Save yourself, and more importantly wikimedia, a whole lot of bandwidth & CPU cycles.
- blacksmith_tb 1y agoAnd torrenting the dumps helps distribute them to others as well.
- detaro 1y agoIf you want to test Mediawiki tooling, wikipedia is good test target, because it uses a lot of the features (unsurprisingly), compared to smaller wikis. (OTOH, the latter often have custom extensions, so it's not quite enough)
- yreg 1y agoSure, but I understood the parent as saying that the tool primarily serves for scraping Wikipedia.
- hoseja 1y agoI had an offline copy of wikipedia from like five years ago, just in case. When I recently needed it I opened the kiwix app and everything was broken by some godforsaken overhaul update. I don't have an offline copy of wikipedia on my new phone anymore.
- ForOldHack 1y agoDoes archive.org have a mirror of the iso?
- flipgimble 1y agoIf I'm reading this right, the last full zim archive of all of english wikipedia is wikipedia_en_all_maxi_2024-01.zim which is now about 16 months old. Is that right, or is are another more recent sources? The current US administration is actively trying to interfere with Wikipedia and censor public speech or information that is detrimental to their disinformation campaign. [1] Do you know if there is an effort to publish more recent archives ? Or do you have any advice how outside developers could jump in to help with that project? [1] - https://news.ycombinator.com/item?id=43799302 https://news.ycombinator.com/item?id=43799302
- prepperdisk 1y agoKiwix team is close on this, it’s even a partnership directly with Wikipedia to work on the newer APIs and function reliably.
- iwantonething 1y agoDo you know when this might be back in stock? https://www.prepperdisk.com/products/prepper-disk-premium-ai-1tb-device-with-ai-chatbot-llm-preorder https://www.prepperdisk.com/products/prepper-disk-premium-ai...
- prepperdisk 1y agoThanks for asking, we just opened up our second preorder wave. Those will ship mid June.
- avni5 1y ago[dead]
- themadturk 1y agoIs there concern for AI-produced slop in Wikipedia? I have the 2024-01 version which may be out of date, but may also have less slop.
- 1y ago