3 ms·
I'd love to see fulltext someday on their Wayback Machine WWW corpus, not just their side projects. I've used it heavily in researching various things but the l
by gwern 9y ago
I'd love to see fulltext someday on their Wayback Machine WWW corpus, not just their side projects. I've used it heavily in researching various things but the limitation to querying by domain or URL is highly restrictive: I'm certain that many of the pages I've failed to find are present in the Wayback Machine at other URLs, either after moving or being quoted or mirrored.
(For example, Google's Blogspot has this amazingly horrible thing of providing the same blog across dozens of national TLDs like 'blog.com', 'blog.co.uk', 'blog.fr' etc - so there may be a full copy of that blog in the WM except it's split across dozens of domains and the Wayback Machine forces you to check every possible permutation of domain name since it can't do a fulltext search.)