3 ms·
> and all linked citations I wonder what percentage of Wikipedia citations are actually currently available on the internet. For example, here is today's feat
by slg 3y ago
> and all linked citations
I wonder what percentage of Wikipedia citations are actually currently available on the internet. For example, here is today's featured article[1]. The majority of references on that pages are books, journals, magazines, television, and unlinked news articles that can't be easily accessed. Plus on more niche topics, it is common for the externally linked references to disappear over time.
[1] - https://en.wikipedia.org/wiki/David_Kelly_(weapons_expert) https://en.wikipedia.org/wiki/David_Kelly_(weapons_expert)
- harshreality 3y agoarchive dot org and dot is, sci-hub and λιβgen / zλιβ will cover a lot of those text sources. Aren't bots largely what's responsible for links being updated to point to archived sources? I've noticed archive links a lot lately. Someone doing serious AI training will mirror sci-hub and λιβgen first, so they'll already have a fair amount of the (good quality) referenced papers and educational books. Wikipedia (and citation count on google scholar for papers) could be used as a filter for which books and papers to train on first.