3 ms·

If you're looking for an open source web crawl, commoncrawl.org has billions of pages.

• greglindahl 10y ago
  ... and Common Search made an index of the homepages, too.