archive dot org and dot is, sci-hub and λιβgen / zλιβ will cover a lot of those text sources. Aren't bots largely what's responsible for links being updated to

archive dot org and dot is, sci-hub and λιβgen / zλιβ will cover a lot of those text sources. Aren't bots largely what's responsible for links being updated to point to archived sources? I've noticed archive links a lot lately. Someone doing serious AI training will mirror sci-hub and λιβgen first, so they'll already have a fair amount of the (good quality) referenced papers and educational books. Wikipedia (and citation count on google scholar for papers) could be used as a filter for which books and papers to train on first.