4 ms·
PageRank might be better way to evaluate quality. It too can be gamed. Maybe not as easily, though.
by asimjalis 7y ago
PageRank might be better way to evaluate quality. It too can be gamed. Maybe not as easily, though.
- apathy 7y agoAka eigenfactor
- ravar 7y agoMy understanding is that eigenfactor rates journals, not individual papers, so if somehow you get low-quality (whatever you want that to mean) papers into nature it has no independent way to realize that your specific paper is low quality. Also eigenfactor is biased towards favoring larger journals, which is not obviously a good thing. It would honestly be really cool if someone did page rank for individual papers. It seems like a much saner metric than anything that is currently used.
- apathy 7y agoOh good grief you’re right. This is doubly sad because using an ensemble metric for per-author eigenfactor seems like it would be tractable. Carl Bergstrom is a smart guy so I suppose the practical implementation of the above must have some wrinkles, but with enough brute force it seems tractable. What I despise more than anything is the gaming that takes place for “impact factor”. I do OK by standard metrics but would very much like to know where I stand by less easily gamed metrics of influence.
- brownbat 7y agoThis is such a pointed reference that I can't tell if you're just being ironic. In a very loose sense, PR is the same algorithm universities use, evaluate quality of some content based on the number of references to that content. It is definitely gamed in similar ways. I'm surprised we haven't seen professors hire SEO firms to help increase citation counts of their research.
- coldtea 7y agoErr, isn't PageRank almost the same as "citations"?
- petschge 7y agoNo, because it counts citations from influential papers with a higher weight.
- pbhjpbhj 7y agoIsn't that how is done in academic circles? Maybe not quantatively but qualitatively surely tenure boards or hiring boards or student applicants notice such things.
- coldtea 7y agoThat's the same with academic scores. Citations in the "Self-published journal of amateur chiropractors" don't buy you much academic credit... In fact PageRank was inspired by academic rankings in that aspect: "PageRank was influenced by citation analysis, early developed by Eugene Garfield in the 1950s at the University of Pennsylvania, and by Hyper Search, developed by Massimo Marchiori at the University of Padua. In the same year PageRank was introduced (1998), Jon Kleinberg published his work on HITS. Google's founders cite Garfield, Marchiori, and Kleinberg in their original papers."
- grecy 7y ago> PageRank might be better way to evaluate quality And suddenly Google is the authoritative source on literally everything in the world. I hope you like their political views, because they would become "the one".
- etaioinshrdlu 7y agoPagerank is referring to the graph algorithm known as pagerank, not anything provided specifically by Google.
- antonvs 7y ago"PageRank" is a Google trademark, and also the subject of a patent belonging to Stanford University and licensed exclusively to Google.
- anticensor 7y agoThat patent expired.
- alexmlamb 7y agoI think this is a neat idea. Basically, you'd get more "credit" if you're cited by a good paper than if you're cited by a bad paper.