3 ms·
Wow! Any idea how much data is there all together? I'm on a work network right now and can't fiddle with it.
by ddtaylor 8y ago
Wow! Any idea how much data is there all together? I'm on a work network right now and can't fiddle with it.
- pen2l 8y agoI too would love the answer to that question. The JSTOR archive that Aaron Swartz wanted released was 35GB. I would imagine SciHub's archive is probably much bigger, maybe a TB+? Also, I wonder if supplementary figures/videos/program code are included in these archives. Probably not, certainly we'd be looking at many TB if such was the case.
- nneonneo 8y agoIt's 54 TiB, and that's just PDFs - no supplementary material. 69 million publications.
- toomuchtodo 8y agoAt least 26TB.
- ddtaylor 8y agoWow! Did you wget all the torrents and run rtorrent or something on them?
- toomuchtodo 8y agoSee https://news.ycombinator.com/item?id=14868033 https://news.ycombinator.com/item?id=14868033 for details.
- jacquesm 8y agoThat's 9 months behind the times.
- toomuchtodo 8y agoIt contains all of the information about the Sci Hub torrents without me linking directly to them.
- jacquesm 8y agoExcept the answer to the question that was asked.
- toomuchtodo 8y agoI appreciate you posting the most up to date corpus size.
- tzs 8y agoHow much of Sci Hub is journals and other actual research papers, and how much is things like articles from general circulation magazines about science? I know there is at least some of the later, because one time when I came across a Sci Hub link before it stopped working, it was to an article from Scientific American.
- jacquesm 8y agoAbout 50T or so from my quick calculations, but: https://www.reddit.com/r/DataHoarder/comments/850s1e/cheapest_way_to_backup_scihub/ https://www.reddit.com/r/DataHoarder/comments/850s1e/cheapes... Has it at almost 60 T and it increases all the time.