4 ms·
Is Wikipedia available as an SQL database dump? That would be really useful.
by jerjerjer 5y ago
Is Wikipedia available as an SQL database dump?
That would be really useful.
- skipnup 5y agoYeah of course, downloadable als SQL or XML: https://en.wikipedia.org/wiki/Wikipedia:Database_download#English-language_Wikipedia https://en.wikipedia.org/wiki/Wikipedia:Database_download#En...
- IfOnlyYouKnew 5y agoYes and no. You can get SQL dumps (although XML is more common), but it doesn't contain any useful structure. The article content is just wikitext, and only metadata such as revisions are structured. You can get a lot of data from Wikidata. They have a SPARQL interface at https://query.wikidata.org/#%23Humans%20born%20in%20New%20York%20City%0Aselect%20distinct%20%3Fitem%20%3FitemLabel%20%3FitemDescription%20%3Fsitelinks%20where%20%7B%0A%20%20%20%20%3Fitem%20wdt%3AP31%20wd%3AQ5%3B%20%20%23%20Any%20instance%20of%20a%20human.%0A%20%20%20%20%20%20%20%20%20%20wdt%3AP19%20wd%3AQ60%3B%20%20%23%20%20Who%20was%20born%20in%20New%20York%20City.%0A%23%20Note.%20Doesn%27t%20include%20humans%20with%20the%20birth%20place%20listed%20as%20a%20hospital%0A%23%20or%20an%20administrative%20area%20or%20other%20location%20of%20New%20York%20City.%0A%23%20Only%20humans%20listed%20as%20born%20in%20New%20York%20City.%20%0A%20%20%20%20%20%20%20%20%20%20%20%20%20wikibase%3Asitelinks%20%3Fsitelinks.%0A%20%20%20%0A%20%20%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22en%2Cnl%22%20%7D%0A%7D%0AORDER%20BY%20DESC%28%3Fsitelinks%29 https://query.wikidata.org/#%23Humans%20born%20in%20New%20Yo... and you can also get all the data in a variety of rdf formats.
- arthurcolle 5y agoYou can get all the edges (links between pages) and nodes (pages and text therein), so not sure what you mean about structure. I loaded all of Wikipedia into Neo4J like 6 months ago... Wasn't very hard.