3 ms·
Have you seen Common Crawl? https://commoncrawl.org/ https://commoncrawl.org/. If so, what differences do you imagine for yours?
by pkghost 4y ago
Have you seen Common Crawl? https://commoncrawl.org/ https://commoncrawl.org/. If so, what differences do you imagine for yours?
- mdaniel 4y ago> continuously updated is what I saw as the primary difference. Whether that's going to pan out in reality as well as it does in HN comments is "the devil's in the details" though