Data extraction from Wikipedia seems to be a task for which there exist a plethora of partial solutions, all different. Partial solutions are perhaps all we ca

Data extraction from Wikipedia seems to be a task for which there exist a plethora of partial solutions, all different. Partial solutions are perhaps all we can hope for, given how hopelessly intermingled semantics and presentation are in the Wikitext format. If you had a completely accurate reimplementation of MediaWiki and all its templates and extensions, what you'd get in the end is HTML pages, and that's not actually data extraction. Here's my project [1], which uses Haskell's Attoparsec library to get at the parts of Wikimedia content that I care about. Currently it extracts plain text from Wikipedia articles, and word relationships from three languages of Wiktionary. [1] https://github.com/LuminosoInsight/wikiparsec https://github.com/LuminosoInsight/wikiparsec