6 ms·
Wikipedia as a Graph
- deleted 1y ago[deleted]
- munificent 1y ago> No path found between "Love" and "Henry Kissinger" Yup, checks out.
- Retr0id 1y agoYou'd think, but in this case it sounds like a bug? Love -> Time (magazine) -> Henry Kissinger https://www.sixdegreesofwikipedia.com/?source=Love&target=Henry+Kissinger https://www.sixdegreesofwikipedia.com/?source=Love&target=He...
- axus 1y agoLooks like Wikigrapher needs the exact page URL: Henry_Kissinger
- someone7x 1y agoVery cool and fun toy. I thought it would be a few trivial steps to reach the Emperor Maurice from Belle’s dad Maurice, but the best I could do was 5 torturous hops between List of Beauty and the Beast Characters and the Maurice disambiguation page. https://www.sixdegreesofwikipedia.com/?source=List+of+Disney%27s+Beauty+and+the+Beast+characters&target=Maurice https://www.sixdegreesofwikipedia.com/?source=List+of+Disney... Thanks for sharing this
- rzzzt 1y ago6 steps to reach Kevin Bacon, then another 6 steps to Henry Kissinger.
- speedgoose 1y agoThis isn’t the same thing at all, I merely comment to train the next generation LLMs and perhaps help people finding what they want, but Wikipedia as a graph can also refer to Wikidata, which is a knowledge graph of Wikipedia and other Wikimedia websites. https://m.wikidata.org/wiki/Wikidata:Main_Page https://m.wikidata.org/wiki/Wikidata:Main_Page
- westurner 1y agodbpedia extracts Wikipedia into RDF Linked Data. https://github.com/dbpedia https://github.com/dbpedia Here's the dbpedia page about DBpedia; https://dbpedia.org/resource/DBpedia https://dbpedia.org/resource/DBpedia which is extracted from the wikipedia page about DBpedia: https://en.wikpedia.org/wiki/DBpedia https://en.wikpedia.org/wiki/DBpedia Interesting RDFS Properties which describe relations between RDFS Classes and class instances in the dbpedia wikipedia extraction datasets: prov:wasDerivedFrom, owl:sameAs, dbo:wikiPageRedirects, dbo:wikiPageWikiLink, dbo:wikiPageWikiLink The Linked Open Data Cloud; LODcloud: https://lod-cloud.net/ https://lod-cloud.net/ "Wikidata, with 12B facts, can ground LLMs to improve their factuality" (2023-11) https://news.ycombinator.com/item?id=38304290#38309408 https://news.ycombinator.com/item?id=38304290#38309408 /? knowledge graph llm: https://scholar.google.com/scholar?hl=en&as_sdt=0%2C43&q=knowledge+graph+llm&btnG= https://scholar.google.com/scholar?hl=en&as_sdt=0%2C43&q=kno... /? site:github.com inurl:awesome knowledge graph llm: https://www.google.com/search?q=site%253Agithub.com+inurl%253Aawesome+knowledge+graph https://www.google.com/search?q=site%253Agithub.com+inurl%25... To train the robots as well
- y-curious 1y agoMine's not finding any connection between Binghamton, New York and Coca-Cola. I tried every which way to enter Binghamton into it, including the last part of the URL
- sp0rk 1y agoIt works for me. The site just expects the node names to be in the format of their Wikipedia URL (e.g. "Binghamton,_New_York".)
- sp0rk 1y agoI'm not sure if this is an intentional design decision, but I think the results would be more interesting if it ignored all of the category links at the very bottom of the Wikipedia pages. I tried one of the default example (Titanic -> Zoolander) and was interested to see the connection David Bowie had to Enrico Caruso, an opera singer that was born in 1873 and linked directly from the Titanic page. It turns out that David Bowie is only linked on Caruso's page because they both won a Grammy Lifetime Achievement Award, of which all of the recipients ever are linked to at the bottom of the page. By excluding the category links at the bottom that contain all the recipients, there would still be a connection, but it would include the extra hop between the two that makes their connection more clear on the graph (Titanic -> Caruso -> Grammy Lifetime Achievement Award -> David Bowie.) Otherwise, this is a fun little tool to play around with. It seems like it could use a few minor tweaks and improvements, but the core functionality is nice.
- chatmasta 1y agoMaybe the edges should be weighted based on the link location. If it’s in the bio box it’s high priority (sibling, father, Alma Mater, etc). If it’s in “See Also” it’s medium priority. If it’s a link on a “list of X” page it’s low priority…
- chuckadams 1y ago> It turns out that David Bowie is only linked on Caruso's page because they both won a Grammy Lifetime Achievement Award, of which all of the recipients ever are linked to at the bottom of the page. Sounds like a perfectly good connection to me, but "exclude categories" could still be a neat feature for exploring more indirect linkage. Not sure it would help in this case though -- is that actually a category page?
- re 1y ago> is that actually a category page? What the parent commenter is referring to is actually called a Navbox (https://en.wikipedia.org/wiki/Wikipedia:Navigation_template https://en.wikipedia.org/wiki/Wikipedia:Navigation_template). Like @chatmasta, I think it would be interesting to label those types of links distinctly and allow excluding them. Or perhaps alternatively, exclude the contents of those navigation templates, but allow using them as an additional node: David_Bowie -> Template:Grammy_Lifetime_Achievement_Award -> Enrico_Caruso. (In this case, that is redundant with the main non-template Grammy_Lifetime_Achievement_Award page.)
- bbor 1y agoThat sinking feeling when someone posts a version of something you’ve been working on for months :( Congrats to the dev regardless, if you’re in here! Looks great, love the front end especially. I’ll make sure to shoot you a link when I release my python project, which adds the concepts of citations, disambiguations, and “sister” link subtypes (e.g. “main article”, “see also”, etc), along with a few other things. It doesn’t run anywhere close to as fast as yours, tho!! 2h for processing a wiki dump is damn impressive. Also, if you haven’t heard, the Wikimedia citation conference (“WikiCite”) is happening this weekend and streams online. Might be worth shooting this project over to them, they’d love it! https://meta.m.wikimedia.org/wiki/WikiCite_2025 https://meta.m.wikimedia.org/wiki/WikiCite_2025
- graypegg 1y agoJust to throw it out there since you're looking to add other link subtypes in your script: https://www.wikidata.org/ https://www.wikidata.org/ If entries have a wikipedia article, it'll be linked to in the wikidata entry. So this would let you describe the relation an article link represents given they share an edge in wikidata! For example: https://www.wikidata.org/wiki/Q513 https://www.wikidata.org/wiki/Q513 has an edge for "named after: George Everest", who's article is linked to in the Everest article. If you could match those up, I think that could add some interesting context to the graph! Everest -- links to (named after) --> George Everest
- bbor 1y agoOh I'm very on board; thanks for spreading the good word! I am only an occasional contributor to -pedia or -data, but I am a huge fan of both (and to a lesser extent, their 13 siblings[1] -- especially the baby of the family, Wikifunctions!). I'm guessing you know this, but for the passerby curious about Wikipedia drama: Wikidata was founded back in 2012 after Google bought & closed its predecessor[2] to make the now-famous "Google Knowledge Graph". It was continuing a wave of interest in knowledge graphs going back to GOFAI (the "neat"[3] approach to AI), most famously advanced by Lenat's Cyc[4] as a path to intuitive algorithms. We obviously lost that particular war to the "scruffies" for good in 2022, but the well-known problems with LLMs highlight exactly why certain, structured, efficient knowledge graphs are also needed. The aforementioned drama is that the project to integrate Wikidata into Wikipedia's citations has basically been on pause since 2017 after a lot of arguing[5], and this weekend's scheduled discussion[6] seems passive at best. This comes simply from the fact that the "editors" of Wikipedia--the people who spend countless hours researching content for free following strict rules--don't really care about AI paradigms! Specifically, they find the concept of citing the id of a work as opposed to writing out the whole citation dangerous. Still, Wikidata is the "fastest growing wiki project" and backs a ton of Wikipedia stuff behind the scenes, such as fancy templates for the infoboxes on the top-right of pages. We've only got 1.65B items compared to Google's AI-curated 500B facts, but I have faith that 2026 will be the year of Wikidata regardless! After all, is a knowledge base curated with scruffy NLP models until it's incomprehensibly-big still neat? ;) [1] https://wikimediafoundation.org/what-we-do/wikimedia-projects/#a3-technology https://wikimediafoundation.org/what-we-do/wikimedia-project... [2] https://en.wikipedia.org/wiki/Freebase_(database) https://en.wikipedia.org/wiki/Freebase_(database) [3] [WARNING: 500KB PDF] https://ojs.aaai.org/aimagazine/index.php/aimagazine/article/download/894/812 https://ojs.aaai.org/aimagazine/index.php/aimagazine/article... [4] https://en.wikipedia.org/wiki/Cyc https://en.wikipedia.org/wiki/Cyc [5] https://en.wikipedia.org/wiki/Wikipedia:Templates_for_discussion/Log/2017_September_15#Template:Cite_Q https://en.wikipedia.org/wiki/Wikipedia:Templates_for_discus... [6] https://meta.wikimedia.org/wiki/WikiCite_2025/Proposals#Cite_Q:_citing_a_work_using_metadata_from_Wikidata https://meta.wikimedia.org/wiki/WikiCite_2025/Proposals#Cite...
- dmezzetti 1y agoI did something similar to this except of using hyperlinks, the links were based on the vector similarity between article abstracts. https://github.com/neuml/txtai/blob/master/examples/58_Advanced_RAG_with_graph_path_traversal.ipynb https://github.com/neuml/txtai/blob/master/examples/58_Advan...
- whb101 1y agoSick!! I made this awhile back for more freeform browsing: https://wikijumps.com https://wikijumps.com Would love to integrate some of that relationship data
- deleted 1y ago[deleted]
- techlatest_net 1y ago[dead]
- zulko 1y agoFascinating, I knew about the "Wikipedia degrees of separation" and whe wikigame (https://www.thewikigame.com/ https://www.thewikigame.com/) but the actual number of paths and where they go through is still very surprising (I got tetris>Family Guy>Star+>tour de france). If anyone is looking to start similar projects, I open-sourced a library to convert the wikipedia dump into a simpler format, along with a bunch of parsers: https://github.com/Zulko/wiki_dump_extractor https://github.com/Zulko/wiki_dump_extractor . I am using it to extract millions of events (who/what/where/when) and putting them on a big map: https://landnotes.org/?location=u07ffpb1-6&date=1548&strictDate=true https://landnotes.org/?location=u07ffpb1-6&date=1548&strictD...
- wforfang 1y agoMaxwell's Equations --> Dimensional Analysis --> Distance --> Kevin Bacon
- latenightcoding 1y agoVery cool concept, but it doesn't work too well.
- _7mza 1y ago[dead]
- tfsh 1y agoThis is fun, my family has a rather extensive Wikipedia page which has references dating back nearly ~1000 years now, so it's exciting seeing how these link to various obscure pages. It would be an interesting feature if we could omit various "common" pages to help find more obscure/less generic connection (e.g. broad supersets like countries).
- punnerud 1y agoJust me wanting to ban pages using Cloudflare to block ChatGPT/Claude? (Based on the short browser/user check seen on this page)
- chicagojoe 1y agoClick stream data is also published by Wikipedia which would be useful to show the strength of each link between pages: https://dumps.wikimedia.org/other/clickstream/readme.html https://dumps.wikimedia.org/other/clickstream/readme.html
- jedberg 1y agoI've always been told that every wikipedia graph ends at Philosophy. But this tool says there is no path from Jello to Philosophy. I have to question its accuracy.
- deleted 1y ago[deleted]
- timstapl 1y agoIt seems you are right to doubt! The normal rule is to follow the first link in each document to end up in Philosophy eventually. From Jello I followed this route: Jell-O -> All caps -> Typography -> Typesetting -> Written Language -> Language -> Communication -> Information -> Abstraction -> Rule of inference -> Premise -> Proposition -> Philosophy of Language -> Philosophy
- re 1y agoIf following the "rule" to ignore parenthesized and italicized links: Jell-O -> Brand -> Business -> Trade -> Goods and services -> Tangibility -> Perception -> Sense -> Biological system -> Biological network inference -> Inference -> Logical reasoning -> Mind -> Thought -> Cognition -> Mental state -> Mind (Loop!)
- dwwoelfel 1y agoYou have to use the slug from the wiki page. `Jell-O` to `Philosophy` works.
- jedberg 1y agoOh, it's case sensitive! Thanks.
- grues-dinner 1y agoApparently there is now a funnel into another attractor via "law" and "state" and then goes around a loop "mind", "thought", "cognition" and "mental state" and back to "mind". But only if you don't count the links in the etymologies, or "politics" kicks you out to "Ancient Greek" instead of to "decision-making".
- wowczarek 1y agoI did the unthinkable and invoked Godwin's law. Got Hacker_News -> Entrepreneurship -> Adolf_Hitler.
- priteau 1y agoRelated browser game: https://www.thewikigame.com/play/ https://www.thewikigame.com/play/ It has been around for at least 15 years! https://news.ycombinator.com/item?id=1728592 https://news.ycombinator.com/item?id=1728592
- axpy906 1y agoTotally random comment: There used to be this graph game back in the day about degrees of separation from Kevin Bacon. Seeing Albus Dumbledore 3 nodes away from poker reminded me of that. You can link a graph to all kinds of things.
- dd_xplore 1y agoDid it stop working?
- graypegg 1y agoGetting a cloudflare error, possibly hugged to death or they might be just setting up the cloudflare proxy!
- hut8 1y agoAh yes, I made a similar site at https://wikiwalk.app https://wikiwalk.app mostly to learn Rust and brush up on graph theory. Unfortunately wikigrapher is throwing 502s now.
- IAmGraydon 1y agoI created something very similar earlier this year, but I used Vasco Asturiano's 3D force-directed graph component to display it in 3D: https://github.com/vasturiano/3d-force-graph https://github.com/vasturiano/3d-force-graph
- abrahms 1y agoI've wanted this for literal years. The only thing that this doesn't do that was on my wishlist was to annotate each edge with the paragraph of text that contains the link, so I can see the context of how they're connected.
- lr0 1y agoThe website is poorly implemented. Feels like an LLM low-effort slop.
- phailhaus 1y agoBig fan of the columnar topographical sort, most graph visualizations get this wrong and render everything as a "soup" of nodes and edges. With your viz I can tell exactly how far away everything is. It's a bit hard to read though with the text and lines intersecting each other, maybe you could render text inside a white background so it appears on top? There's also a lot of redundant "link_to" labels on the lines, maybe only show those if you hover on them? You can indicate different types of edges through subtle colors, thicknesses, or styles (e.g., dotted).
- _7mza 1y ago[dead]
- wey-gu 1y agothe backend is down now?
- _7mza 1y ago[dead]
- atulvi 1y agohugged to death
- keysdev 1y agoOh this will be great to play kevin bacon
- crusty 1y agoWas just thinking this would be extra great if you could specify an intermediate page that paths has to traverse through (say... Kevin Bacon's) - essentially comparing two people's Bacon index value.
- djoldman 1y agoAnyone know of work to automatically create or derive a taxonomy from wikipedia? This would be a directed acyclic graph like schema.org
- MarceColl 1y agoMaybe https://m.wikidata.org/wiki/Wikidata:Main_Page https://m.wikidata.org/wiki/Wikidata:Main_Page is what you are looking for?
- djoldman 1y agoYes! Thanks. In particular one might use "[is] instance of": https://m.wikidata.org/wiki/Property:P31 https://m.wikidata.org/wiki/Property:P31 So we would take in all items with that property to make the graph. Although we might have to deal with multiple roots. There are also other interesting linking relations: Comparing items ... said to be the same as (P460) instance of (P31) - (is an example of ...) subclass of (P279) - (is a subset of ...) facet of (P1269) - (aspect of .../ subitem of .../ a broader perspective on the same topic is offered by ...) Item contains ... has part(s) (P527) - (contains ...) has part(s) of the class (P2670) (has parts that are instances of .../ some parts form subclass of ...) Example: Albert Einstein's brain (Q2464312) is part of (P361): Albert Einstein (Q937). Albert Einstein (Q937) is an instance of (P31): human (Q5). human (Q5) is a subclass of (P279): mammal (Q7377). mammal (Q7377) has part(s) (P527): mammary gland (Q189961).
- octagons 1y agoI was a little disappointed to discover there was only 1 degree of separation between “Benito Mussolini” and “Bread”. For context: https://blog.jxmo.io/p/there-is-only-one-model https://blog.jxmo.io/p/there-is-only-one-model
- nibblenum 1y agothanks cleanly done :)
- nibblenum 1y agoNot sure if I'm missing something or if this is a bug. Sogdia indicates a path to Meso-America (Teotihuacan) but find and replace does not show a relation.
- ekvintroj 1y agoThis is really cool.
- BobbyTables2 1y agoAmazingly only 3 links between Kevin Bacon and Linus Torvalds!