3 ms·Common Crawl is great! however, some use cases require larger crawls with a higher frequency.by outpan 10y agoCommon Crawl is great! however, some use cases require larger crawls with a higher frequency.