3 ms·
Common crawl already exists and is nearly as good as Google's index.
by otherotherchris 5y ago
Common crawl already exists and is nearly as good as Google's index.
- marginalia_nu 5y agoCommon crawl is just a dataset, not an index. The difficulty is not finding a sufficiently large haystack, it's getting at the needles.