4 ms·
It seems like downloads from Sci-Hub and citations could have a common cause, for example, being interesting to scientists. If Sci-Hub downloads are a good prox
by skybrian 6y ago
It seems like downloads from Sci-Hub and citations could have a common cause, for example, being interesting to scientists. If Sci-Hub downloads are a good proxy for interest and they happen first, then they could usefully be used to predict citations, without necessarily being a cause. Different people could be using SciHub versus making citations.
I couldn't tell from the paper whether they considered this, or what they think the cause graph looks like.
- kgwgk 6y ago"After controlling for problems of endogeneity, heteroscedasticity, and inconsistency, the interpretation of our robust estimates goes beyond claiming mere correlations or associations." They think they have showed causality. If it only was so easy...
- barbegal 6y agoYeah it doesn't look like they consulted a statistician when doing this research. It always amazes me how a paper like this can be 90% statistics based but non of the authors are statisticians. Without the proper statistical analysis it just becomes a paper on how highly cited papers get downloaded from Sci-Hub which isn't very interesting.
- hatsunearu 6y agoWhoever reviews this is probably going to go ballistic lol
- js8 6y agoThe reviewers should still hedge their bets and make sure their research is available on Sci-Hub.
- fxtentacle 6y agoThere is a very obvious cause, which is that people tend not to cite papers that they have never seen. So if your reviewer tells you that you need more citations, you use the stuff that's easiest to get.
- kgwgk 6y agoYou use the stuff cited in the citations you already have :-)
- tasogare 6y agoWell, if a paper is available in Sci-Hub I’ll download it and I may cite it, while of it’s not I won’t so their is 0 chance I’ll cite it. My university system was already annoying to use, but now they switched to a Chrome extension that is not working half of the time. Not worth bothering with it.
- thaumasiotes 6y ago> It seems like downloads from Sci-Hub and citations could have a common cause, for example, being interesting to scientists. If Sci-Hub downloads are a good proxy for interest and they happen first, then they could usefully be used to predict citations So far so good. > , without necessarily being a cause. The logic has fallen apart. In order for the downloads not to be a cause, the same citations would have to occur in their counterfactual absence. You're claiming that anyone who downloads a paper from Sci-Hub would, in the absence of Sci-Hub, obtain that paper by other means. Compare the currently higher-positioned thread ( https://news.ycombinator.com/item?id=23710896 https://news.ycombinator.com/item?id=23710896 ), where this paper is getting slammed for concluding that limiting the availability of a paper may prevent the research described in that paper from "achieving its full impact". On your analysis, where Sci-Hub downloads are driven by interest from scientists and that explains the entire more-downloads-means-more-citations effect, that conclusion is 100% correct.
- kgwgk 6y ago> The logic has fallen apart. Note the words used in the argument: "could have a common cause", "without necessarily being a cause". The logic that fails is the one that depends on a common cause being impossible and concludes that one thing is necessarily causing the other. (It plausably may do so to some extent, but that paper doesn't prove that nor gives a good estimate of the effect.)
- thaumasiotes 6y agoNo, I specifically agree that they have a common cause. Nobody's depending on a common cause being impossible. But they cannot be coincidentally related by a common cause! This is clearly a causality chain: 1. interest in the paper -> reading the paper 2. reading the paper -> citing the paper It is not: 1. interest in the paper -> reading the paper 2. interest in the paper -> citing the paper You can't seriously believe that interest in the paper can lead to citations of the paper without being intermediated through reading the paper! And that intermediary position of Sci-Hub means that, in the model described, it cannot possibly fail to be a cause of citations. That would be the same argument as "one game downloaded through piracy equals one lost sale". If you don't believe that one illegal download = one lost sale, you've immediately admitted that piracy is a cause of additional gameplay.
- mzl 6y agoSimilar to many other commenters, I don't really believe the far-reaching conclusions in the paper either. As a scientist, the papers that I download from Sci-Hub are mostly the ones I am interested in with regards to my current research projects, and as such are quite likely to be cited. Or in other words, the work I do predicts which papers I download and which papers I cite. There may be some causation of availability to citations, but I believe it would have been more interesting _before_ Sci-Hub. That is, I would guess that papers freely available somewhere on the internet (mostly home-pages for scientists) would have more citations than papers that are just available behind a pay-wall. For me, Sci-Hub has changed my citations from "just those I can get my hands on", to "any paper I'm interested in".
- joshvm 6y agoThe obvious way to assess if availability is the factor is to look at open access publications. Elsevier (unsurprisingly) say it makes no difference [1] and there are confounding effects which are stronger. For example, papers with code tend to be cited more in ML. And it's very difficult to control for article quality, which is a big factor (MDPI's quality is extremely hit/miss, for example). Open access may improve your paper's reach, but will it actually give you more citations? Unclear. I'm very much in favour of open research though. On the matter of Sci-Hub. I already have access to all the journals I commonly use via my university. Those journals almost certainly track downloads (Elsevier even has a recommender system when you download a paper). All Sci-Hub does is reduce friction for researchers who can't be bothered to use their institutional login while off campus. Admittedly that includes a lot of people, but for the people who measurably contribute to citation metrics, does Sci-Hub actually improve availability? I doubt it, at least in universities with budgets for subscriptions. Before Sci-Hub there were always routes to get papers: ask the author or ask a colleague in a neighbouring university if they have access. Or you can ask your library who may be able to get it. My point is that generally it was a bit more work sometimes, but in the grand scheme of publishing a paper, it wasn't so bad to network to get access to things. It's certainly enabled the general public to access research and no doubt tons of small companies are using it to avoid paying for subscription fees, but those people aren't significantly publishing papers in places where we can measure it. All this study shows is that paper downloads from anywhere is a proxy for popularity/hype which can be a proxy for citation count. I'm sure Elsevier or Taylor or Nature could provide a similar correlation between downloads and citations. There is also a bias here - if I'm looking for papers, I'm probably going to download the most highly cited stuff first because that's a weak signal that it's a useful paper. I'd be more interested to see, as you said, temporal analysis of before/after Sci-Hub. Or alternatively geographical studies - does this affect lower income countries more? I imagine that this is a boon to researchers who didn't have access because their institution couldn't afford it. [1] https://www.elsevier.com/connect/citation-metrics-and-open-access-what-do-we-know https://www.elsevier.com/connect/citation-metrics-and-open-a...