3 ms·

We (scite.ai) have extracted 918M citation statements (3 full sentences) from 27M full-text articles (more than half are from paywalled articles from indexing a

We (scite.ai) have extracted 918M citation statements (3 full sentences) from 27M full-text articles (more than half are from paywalled articles from indexing agreements). We've taken this an extra step and have classified the citation statements as providing supporting or contrasting evidence (https://direct.mit.edu/qss/article/doi/10.1162/qss_a_00146/102990/Scite-A-smart-citation-index-that-displays-the https://direct.mit.edu/qss/article/doi/10.1162/qss_a_00146/1...) And, recently, have made these citation statements easily searchable to find expert analyses and opinions on nearly any topic extracted from the literature: https://scite.ai/search/citations https://scite.ai/search/citations

pedalpete 5y ago
Nice work on Scite, I'm not sure if this is a different use case than I have, but my searches are listing duplicates of the same papers many times. Is there a reason to not collapse duplicates into a single result?
- jmnicholson 5y ago
  Is this on Citation Statement search? I think it is probably because the citation context contains two or more citations in it. We look at citations per sentence so it is duplicated there. I can see how that is confusing though.
a3_nm 5y ago
This looks very nice! is it possible to download the dataset? (PS: comparable initiative of citation datasets that are downloadable: S2ORC https://github.com/allenai/s2orc https://github.com/allenai/s2orc and Internet Archive Refcat https://blog.archive.org/2021/10/19/internet-archive-releases-refcat-the-ia-scholar-index-of-over-1-3-billion-scholarly-citations/ https://blog.archive.org/2021/10/19/internet-archive-release...)
- jmnicholson 5y ago
  We can't release the full dataset as our licensing agreements with publishers restrict it. We do have an API though that can be used: https://api.scite.ai/docs https://api.scite.ai/docs

pedalpete 5y ago

Nice work on Scite, I'm not sure if this is a different use case than I have, but my searches are listing duplicates of the same papers many times. Is there a reason to not collapse duplicates into a single result?

jmnicholson 5y ago
Is this on Citation Statement search? I think it is probably because the citation context contains two or more citations in it. We look at citations per sentence so it is duplicated there. I can see how that is confusing though.

a3_nm 5y ago

This looks very nice! is it possible to download the dataset? (PS: comparable initiative of citation datasets that are downloadable: S2ORC https://github.com/allenai/s2orc https://github.com/allenai/s2orc and Internet Archive Refcat https://blog.archive.org/2021/10/19/internet-archive-releases-refcat-the-ia-scholar-index-of-over-1-3-billion-scholarly-citations/ https://blog.archive.org/2021/10/19/internet-archive-release...)

jmnicholson 5y ago
We can't release the full dataset as our licensing agreements with publishers restrict it. We do have an API though that can be used: https://api.scite.ai/docs https://api.scite.ai/docs