3 ms·
The solution to this is reputation. The flaw is that we're using the reputation of for-profit journals rather than the research institutions. You shouldn't hav
by AnthonyMouse 3y ago
The solution to this is reputation. The flaw is that we're using the reputation of for-profit journals rather than the research institutions.
You shouldn't have confidence in a paper because it was published in Nature, you should have confidence in it because it was published by Harvard or the University of California or Google Research, who puts the name of their institution on it and thereby stakes their reputation. For the preeminent researchers in a field, their own names may be enough for people in that field to trust the result.
You can still have a paper published by nobody, and if the results are interesting, researchers at known institutions can try to replicate it. Until then it's nothing. But if they do, the nobody gets cited and credited with being the first and takes a step to building their own reputation, and the known institution gets credited with knowing when to spend resources following up on something significant.
- notahacker 3y agoThe research institutes are also for profit bodies, just much more of an closed shop because there's only so many people they can employ at any one time (and that's before we even get into tenure or the fact all you're really doing is shifting the peer review burden onto people that report into the person that wrote the paper). You can have papers published by Google Research or by nobody now: turns out academics like the journals' attempts to curate interesting stuff more than only ever reading stuff on their bookmark list or that's mailed to them in a desperate attempt to get some engagement. And for all that they might not like the long delays and low chance of success associated with submitting to Nature, they like the idea of trying to persuade an academic at an elite institution to go to the trouble of replicating their research as the only means to build their reputation even less...
- AnthonyMouse 3y ago> The research institutes are also for profit bodies Their business model isn't to put the research behind a paywall, which is the relevant distinction. > turns out academics like the journals' attempts to curate interesting stuff more than only ever reading stuff on their bookmark list or that's mailed to them in a desperate attempt to get some engagement. This is what conferences are for, and then you have the conference organizers curating the talks but everyone gets the list of talks and links to all the freely available papers even if they can't afford to attend the conference.
- ImPostingOnHN 3y agoA research institution can produce bad researchers (Harvard, UC, and Google included), so we can't go with this suggestion either, instead we'd need reputation for each individual researcher in the world. how many such reputations can you keep track of and gauge trust along? and how is reputation gauged if peers don't review work?
- AnthonyMouse 3y ago> A research institution can produce bad researchers (Harvard, UC, and Google included), so we can't go with this suggestion either Why not? The same is true of an individual researcher. But if they do, it damages their reputation, so they have an incentive to not. The same as the institution.
- ImPostingOnHN 3y ago> Why not? because it can produce bad researchers, and thus cannot be trusted to indicate good vs. bad researchers thus, it is a bad proxy for trust of individual researchers >The same is true of an individual researcher individual researchers are not research institutions, so the same literally cannot be true: one employs the other, the inverse is not true > if they do, it damages their reputation, so they have an incentive to not empirically speaking, they objectively do, and their reputation is not damaged, and thus above proposition about reputation and incentives does not appear to be true enough to stop it from happening recall the topic is how to gauge individual researcher reputation in the first place. Either we do it on an individual basis or a group/heuristic basis, and of the latter, research publications are a better proxy than what school one went to, but the former is better than both