3 ms·
This is awesome work! Is there anywhere we can get the generated graph data? Whether in the form of adjacency list or matrix. I want to do some analysis on this
by yzh 11y ago
This is awesome work! Is there anywhere we can get the generated graph data? Whether in the form of adjacency list or matrix. I want to do some analysis on this graph too :-)
- jsnider3 11y agoI have it as a SQLite database on my machine. The full database is too big to upload to GitHub, but I'll see if the table with the edges can be made into a small enough JSON file to be uploaded.
- jsnider3 11y agoCheck out https://raw.githubusercontent.com/jsnider3/QuisCustodiet/master/edges.js https://raw.githubusercontent.com/jsnider3/QuisCustodiet/mas....
- yzh 11y agoThanks a lot for doing this man!
- yzh 11y agoI have tried some graph analysis using my own graph analytics framework: Gunrock (http://gunrock.github.io/gunrock/ http://gunrock.github.io/gunrock/). The PageRank is pretty similar (the first three are DoctorWho, StarWars, and EVA.) My colleague and I are interested in doing more analysis on this site. We are trying to build a crawler and maybe using bipartite graph to build some kind of recommendation system. All inspired by your project here. Stay tuned :-)
- jsnider3 11y agoThanks, this is exactly the kind of thing I hope to happen when I post on HN. I have the crawler I used at https://github.com/jsnider3/QuisCustodiet/blob/master/crawler.py https://github.com/jsnider3/QuisCustodiet/blob/master/crawle..., but it needs some post-processing at the end to filter out links that redirect and pages that aren't works of pop culture.
- yzh 11y agoThis is great. It helps a lot!