4 ms·

But the reason they are considered qualified to serve as credentialing authorities is, in part, due to their perceived reliability. Of course the significance o

by jack6e 9y ago

But the reason they are considered qualified to serve as credentialing authorities is, in part, due to their perceived reliability. Of course the significance of published work and its influence on the field is perhaps the primary driver of a journal's reputation for readers, but significant work can only be influential if it is also reliable. Were a journal's readership to realize that its publications could not be trusted, it would lose influence and thus the perception that having work published in it is a meaningful professional achievement.

eeeii93 9y ago
I would like to see these sorts of analyses done over time, although I'm not sure it's possible (in the very least it would require a tremendous amount of work). Anecdotally in speaking to people who have been in academic research for awhile, things started changing in the late 90s, plus or minus several years. I've heard a similar story repeatedly and independently about different aspects of the system, but in aggregate there's some sense that there has been change in academic research culture that started around that time. I wonder if the relative quality signal of different types of journals has changed dramatically over time.
Vinnl 9y ago
Is it, though? Are researchers even aware when previous research has been retracted? Retracted research often continues to amass new citations (which, of course, need not necessarily be positive). Although I would certainly not assert that research in the "top" journals is particularly unreliable, it is not unbelievable that, when they tend to publish more extraordinary result, a smaller percentage of that tends to be true. I have not seen any indication that that leads to such journals losing influence, and it certainly doesn't lead to the Impact Factor being lowered - which often influences the "perception that having work published in it is a meaningful professional achievement".
- 2020-3030 9y ago
  The Retraction Watch website http://retractionwatch.com/ http://retractionwatch.com/ is one good method of highlighting retracted work. For researchers in any given field, keeping current on literature is hard work given the pace of publication but does include seeing retractions. So, the answer to your question depends on which researchers we mean. Experts in a field have the best chance of noticing relevant retractions in their own field. If you are a researcher in one field who has interests in many other fields, it is probably much less likely that you will be able to follow the retractions in those peripheral fields. That is why Retraction Watch and other mechanisms of highlighting such errors is useful.

by jack6e 9y ago

eeeii93 9y ago

I would like to see these sorts of analyses done over time, although I'm not sure it's possible (in the very least it would require a tremendous amount of work). Anecdotally in speaking to people who have been in academic research for awhile, things started changing in the late 90s, plus or minus several years. I've heard a similar story repeatedly and independently about different aspects of the system, but in aggregate there's some sense that there has been change in academic research culture that started around that time. I wonder if the relative quality signal of different types of journals has changed dramatically over time.

Vinnl 9y ago

Is it, though? Are researchers even aware when previous research has been retracted? Retracted research often continues to amass new citations (which, of course, need not necessarily be positive). Although I would certainly not assert that research in the "top" journals is particularly unreliable, it is not unbelievable that, when they tend to publish more extraordinary result, a smaller percentage of that tends to be true. I have not seen any indication that that leads to such journals losing influence, and it certainly doesn't lead to the Impact Factor being lowered - which often influences the "perception that having work published in it is a meaningful professional achievement".

2020-3030 9y ago
The Retraction Watch website http://retractionwatch.com/ http://retractionwatch.com/ is one good method of highlighting retracted work. For researchers in any given field, keeping current on literature is hard work given the pace of publication but does include seeing retractions. So, the answer to your question depends on which researchers we mean. Experts in a field have the best chance of noticing relevant retractions in their own field. If you are a researcher in one field who has interests in many other fields, it is probably much less likely that you will be able to follow the retractions in those peripheral fields. That is why Retraction Watch and other mechanisms of highlighting such errors is useful.