3 ms·
Common crawl is just a dataset, not an index. The difficulty is not finding a sufficiently large haystack, it's getting at the needles.
by marginalia_nu 5y ago
Common crawl is just a dataset, not an index. The difficulty is not finding a sufficiently large haystack, it's getting at the needles.